2023-09-22 17:01:46,645 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-22 17:01:46,850 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2 2023-09-22 17:01:46,850 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-22 17:01:46,851 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-22 17:01:46,890 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-22 17:01:47,139 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-22 17:01:47,140 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f, deleteOnExit=true 2023-09-22 17:01:47,140 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-22 17:01:47,140 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/test.cache.data in system properties and HBase conf 2023-09-22 17:01:47,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop.tmp.dir in system properties and HBase conf 2023-09-22 17:01:47,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop.log.dir in system properties and HBase conf 2023-09-22 17:01:47,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-22 17:01:47,142 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-22 17:01:47,142 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-22 17:01:47,460 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-22 17:01:47,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-22 17:01:47,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-22 17:01:47,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-22 17:01:47,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 17:01:47,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-22 17:01:47,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-22 17:01:47,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 17:01:47,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 17:01:47,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-22 17:01:47,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/nfs.dump.dir in system properties and HBase conf 2023-09-22 17:01:47,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir in system properties and HBase conf 2023-09-22 17:01:47,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 17:01:47,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-22 17:01:47,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-22 17:01:48,007 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-22 17:01:48,012 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-22 17:01:48,311 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-22 17:01:48,488 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-22 17:01:48,508 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:01:48,559 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:01:48,593 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_localhost_37475_hdfs____.dn1elk/webapp 2023-09-22 17:01:48,725 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37475 2023-09-22 17:01:48,737 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-22 17:01:48,737 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-22 17:01:49,274 WARN [Listener at localhost/44043] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 17:01:49,353 WARN [Listener at localhost/44043] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 17:01:49,374 WARN [Listener at localhost/44043] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:01:49,427 INFO [Listener at localhost/44043] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:01:49,436 INFO [Listener at localhost/44043] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_localhost_40337_datanode____svx0le/webapp 2023-09-22 17:01:49,542 INFO [Listener at localhost/44043] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40337 2023-09-22 17:01:49,932 WARN [Listener at localhost/37875] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 17:01:49,952 WARN [Listener at localhost/37875] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 17:01:49,955 WARN [Listener at localhost/37875] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:01:49,957 INFO [Listener at localhost/37875] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:01:49,967 INFO [Listener at localhost/37875] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_localhost_44623_datanode____qndjha/webapp 2023-09-22 17:01:50,067 INFO [Listener at localhost/37875] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44623 2023-09-22 17:01:50,080 WARN [Listener at localhost/44379] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 17:01:50,101 WARN [Listener at localhost/44379] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-22 17:01:50,105 WARN [Listener at localhost/44379] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:01:50,106 INFO [Listener at localhost/44379] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:01:50,114 INFO [Listener at localhost/44379] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_localhost_32879_datanode____3lcci/webapp 2023-09-22 17:01:50,254 INFO [Listener at localhost/44379] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32879 2023-09-22 17:01:50,285 WARN [Listener at localhost/37331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-22 17:01:50,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30b95d5675be5c35: Processing first storage report for DS-7e9299ec-6f47-4299-8729-8068e374e92a from datanode bdbdc702-9080-43e4-9380-69efcacc7913 2023-09-22 17:01:50,565 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30b95d5675be5c35: from storage DS-7e9299ec-6f47-4299-8729-8068e374e92a node DatanodeRegistration(127.0.0.1:44577, datanodeUuid=bdbdc702-9080-43e4-9380-69efcacc7913, infoPort=35389, infoSecurePort=0, ipcPort=37875, storageInfo=lv=-57;cid=testClusterID;nsid=881735277;c=1695402108093), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-22 17:01:50,566 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb29e9a7605a4db8e: Processing first storage report for DS-e09c84ce-309f-4647-881e-a778c075779d from datanode 0a738b8f-b791-4e7d-95ea-c7d0bc85ee8a 2023-09-22 17:01:50,566 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb29e9a7605a4db8e: from storage DS-e09c84ce-309f-4647-881e-a778c075779d node DatanodeRegistration(127.0.0.1:45357, datanodeUuid=0a738b8f-b791-4e7d-95ea-c7d0bc85ee8a, infoPort=42025, infoSecurePort=0, ipcPort=44379, storageInfo=lv=-57;cid=testClusterID;nsid=881735277;c=1695402108093), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 17:01:50,566 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44e584acf212770c: Processing first storage report for DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a from datanode 7c65220d-1d92-4fd4-8d03-ea90c3400867 2023-09-22 17:01:50,566 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44e584acf212770c: from storage DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a node DatanodeRegistration(127.0.0.1:45691, datanodeUuid=7c65220d-1d92-4fd4-8d03-ea90c3400867, infoPort=41345, infoSecurePort=0, ipcPort=37331, storageInfo=lv=-57;cid=testClusterID;nsid=881735277;c=1695402108093), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 17:01:50,566 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30b95d5675be5c35: Processing first storage report for DS-32c4b43d-6872-452e-abe3-c0912288da5f from datanode bdbdc702-9080-43e4-9380-69efcacc7913 2023-09-22 17:01:50,566 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30b95d5675be5c35: from storage DS-32c4b43d-6872-452e-abe3-c0912288da5f node DatanodeRegistration(127.0.0.1:44577, datanodeUuid=bdbdc702-9080-43e4-9380-69efcacc7913, infoPort=35389, infoSecurePort=0, ipcPort=37875, storageInfo=lv=-57;cid=testClusterID;nsid=881735277;c=1695402108093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 17:01:50,567 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb29e9a7605a4db8e: Processing first storage report for DS-b2d36427-95a0-4a38-9dfa-486a1532f660 from datanode 0a738b8f-b791-4e7d-95ea-c7d0bc85ee8a 2023-09-22 17:01:50,567 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb29e9a7605a4db8e: from storage DS-b2d36427-95a0-4a38-9dfa-486a1532f660 node DatanodeRegistration(127.0.0.1:45357, datanodeUuid=0a738b8f-b791-4e7d-95ea-c7d0bc85ee8a, infoPort=42025, infoSecurePort=0, ipcPort=44379, storageInfo=lv=-57;cid=testClusterID;nsid=881735277;c=1695402108093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 17:01:50,567 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44e584acf212770c: Processing first storage report for DS-83b092f4-2a3e-4c5f-ace2-98f33c27ef9d from datanode 7c65220d-1d92-4fd4-8d03-ea90c3400867 2023-09-22 17:01:50,567 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44e584acf212770c: from storage DS-83b092f4-2a3e-4c5f-ace2-98f33c27ef9d node DatanodeRegistration(127.0.0.1:45691, datanodeUuid=7c65220d-1d92-4fd4-8d03-ea90c3400867, infoPort=41345, infoSecurePort=0, ipcPort=37331, storageInfo=lv=-57;cid=testClusterID;nsid=881735277;c=1695402108093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-22 17:01:50,772 DEBUG [Listener at localhost/37331] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2 2023-09-22 17:01:50,873 INFO [Listener at localhost/37331] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/zookeeper_0, clientPort=51340, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-22 17:01:50,893 INFO [Listener at localhost/37331] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51340 2023-09-22 17:01:50,901 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:50,903 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:51,606 INFO [Listener at localhost/37331] util.FSUtils(471): Created version file at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e with version=8 2023-09-22 17:01:51,606 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/hbase-staging 2023-09-22 17:01:52,011 INFO [Listener at localhost/37331] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-22 17:01:52,552 INFO [Listener at localhost/37331] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 17:01:52,585 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:52,585 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:52,585 INFO [Listener at localhost/37331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 17:01:52,586 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:52,586 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 17:01:52,725 INFO [Listener at localhost/37331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 17:01:52,805 DEBUG [Listener at localhost/37331] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-22 17:01:52,898 INFO [Listener at localhost/37331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33079 2023-09-22 17:01:52,911 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:52,913 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:52,937 INFO [Listener at localhost/37331] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33079 connecting to ZooKeeper ensemble=127.0.0.1:51340 2023-09-22 17:01:52,992 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:330790x0, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 17:01:52,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33079-0x100d49667260000 connected 2023-09-22 17:01:53,021 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 17:01:53,021 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:01:53,034 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 17:01:53,042 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33079 2023-09-22 17:01:53,045 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33079 2023-09-22 17:01:53,049 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33079 2023-09-22 17:01:53,049 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33079 2023-09-22 17:01:53,050 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33079 2023-09-22 17:01:53,056 INFO [Listener at localhost/37331] master.HMaster(444): hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, hbase.cluster.distributed=false 2023-09-22 17:01:53,120 INFO [Listener at localhost/37331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 17:01:53,121 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,121 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,121 INFO [Listener at localhost/37331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 17:01:53,121 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,121 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 17:01:53,126 INFO [Listener at localhost/37331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 17:01:53,129 INFO [Listener at localhost/37331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40079 2023-09-22 17:01:53,132 INFO [Listener at localhost/37331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 17:01:53,138 INFO [Listener at localhost/37331] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 17:01:53,139 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,141 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,143 INFO [Listener at localhost/37331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40079 connecting to ZooKeeper ensemble=127.0.0.1:51340 2023-09-22 17:01:53,153 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:400790x0, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 17:01:53,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40079-0x100d49667260001 connected 2023-09-22 17:01:53,154 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 17:01:53,156 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:01:53,157 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 17:01:53,160 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40079 2023-09-22 17:01:53,161 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40079 2023-09-22 17:01:53,161 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40079 2023-09-22 17:01:53,162 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40079 2023-09-22 17:01:53,165 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40079 2023-09-22 17:01:53,178 INFO [Listener at localhost/37331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 17:01:53,178 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,178 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,179 INFO [Listener at localhost/37331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 17:01:53,179 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,179 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 17:01:53,179 INFO [Listener at localhost/37331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 17:01:53,182 INFO [Listener at localhost/37331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44379 2023-09-22 17:01:53,182 INFO [Listener at localhost/37331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 17:01:53,184 INFO [Listener at localhost/37331] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 17:01:53,185 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,188 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,191 INFO [Listener at localhost/37331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44379 connecting to ZooKeeper ensemble=127.0.0.1:51340 2023-09-22 17:01:53,198 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:443790x0, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 17:01:53,199 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:443790x0, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 17:01:53,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44379-0x100d49667260002 connected 2023-09-22 17:01:53,200 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:01:53,201 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 17:01:53,205 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44379 2023-09-22 17:01:53,205 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44379 2023-09-22 17:01:53,205 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44379 2023-09-22 17:01:53,206 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44379 2023-09-22 17:01:53,206 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44379 2023-09-22 17:01:53,219 INFO [Listener at localhost/37331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-22 17:01:53,219 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,219 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,220 INFO [Listener at localhost/37331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-22 17:01:53,220 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-22 17:01:53,220 INFO [Listener at localhost/37331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-22 17:01:53,220 INFO [Listener at localhost/37331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-22 17:01:53,221 INFO [Listener at localhost/37331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44467 2023-09-22 17:01:53,222 INFO [Listener at localhost/37331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-22 17:01:53,225 INFO [Listener at localhost/37331] mob.MobFileCache(124): MobFileCache disabled 2023-09-22 17:01:53,226 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,228 INFO [Listener at localhost/37331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,229 INFO [Listener at localhost/37331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44467 connecting to ZooKeeper ensemble=127.0.0.1:51340 2023-09-22 17:01:53,233 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:444670x0, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-22 17:01:53,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44467-0x100d49667260003 connected 2023-09-22 17:01:53,234 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 17:01:53,235 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:01:53,236 DEBUG [Listener at localhost/37331] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-22 17:01:53,236 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44467 2023-09-22 17:01:53,237 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44467 2023-09-22 17:01:53,237 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44467 2023-09-22 17:01:53,238 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44467 2023-09-22 17:01:53,238 DEBUG [Listener at localhost/37331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44467 2023-09-22 17:01:53,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:53,248 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-22 17:01:53,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:53,269 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 17:01:53,269 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 17:01:53,269 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 17:01:53,269 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-22 17:01:53,270 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:53,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-22 17:01:53,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33079,1695402111785 from backup master directory 2023-09-22 17:01:53,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-22 17:01:53,277 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:53,278 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-22 17:01:53,279 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 17:01:53,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:53,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-22 17:01:53,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-22 17:01:53,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/hbase.id with ID: 04192552-f758-4cc0-8a8a-23bdf3febe41 2023-09-22 17:01:53,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-22 17:01:53,463 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:53,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7817b55b to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:01:53,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ca9cf79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:01:53,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-22 17:01:53,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-22 17:01:53,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-22 17:01:53,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-22 17:01:53,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-22 17:01:53,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-22 17:01:53,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 17:01:53,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store-tmp 2023-09-22 17:01:53,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-22 17:01:53,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:01:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:01:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-22 17:01:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:01:53,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:01:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 17:01:53,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/WALs/jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:53,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33079%2C1695402111785, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/WALs/jenkins-hbase4.apache.org,33079,1695402111785, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/oldWALs, maxLogs=10 2023-09-22 17:01:53,786 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK] 2023-09-22 17:01:53,786 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK] 2023-09-22 17:01:53,786 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK] 2023-09-22 17:01:53,795 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-22 17:01:53,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/WALs/jenkins-hbase4.apache.org,33079,1695402111785/jenkins-hbase4.apache.org%2C33079%2C1695402111785.1695402113725 2023-09-22 17:01:53,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK], DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK], DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK]] 2023-09-22 17:01:53,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-22 17:01:53,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:53,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 17:01:53,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 17:01:53,938 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-22 17:01:53,946 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-22 17:01:53,984 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-22 17:01:53,997 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:54,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-22 17:01:54,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-22 17:01:54,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-22 17:01:54,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:01:54,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75400339, jitterRate=0.123552605509758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:01:54,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 17:01:54,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-22 17:01:54,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-22 17:01:54,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-22 17:01:54,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-22 17:01:54,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-22 17:01:54,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 38 msec 2023-09-22 17:01:54,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-22 17:01:54,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-22 17:01:54,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-22 17:01:54,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-22 17:01:54,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-22 17:01:54,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-22 17:01:54,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-22 17:01:54,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-22 17:01:54,185 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:54,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-22 17:01:54,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-22 17:01:54,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-22 17:01:54,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 17:01:54,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 17:01:54,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:54,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 17:01:54,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-22 17:01:54,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33079,1695402111785, sessionid=0x100d49667260000, setting cluster-up flag (Was=false) 2023-09-22 17:01:54,223 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:54,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-22 17:01:54,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:54,241 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:54,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-22 17:01:54,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:54,251 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp 2023-09-22 17:01:54,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-22 17:01:54,342 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(951): ClusterId : 04192552-f758-4cc0-8a8a-23bdf3febe41 2023-09-22 17:01:54,346 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(951): ClusterId : 04192552-f758-4cc0-8a8a-23bdf3febe41 2023-09-22 17:01:54,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:54,342 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(951): ClusterId : 04192552-f758-4cc0-8a8a-23bdf3febe41 2023-09-22 17:01:54,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-22 17:01:54,354 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 17:01:54,354 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 17:01:54,354 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-22 17:01:54,362 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 17:01:54,362 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 17:01:54,362 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-22 17:01:54,362 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 17:01:54,362 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 17:01:54,363 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-22 17:01:54,366 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 17:01:54,366 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 17:01:54,366 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-22 17:01:54,371 DEBUG [RS:1;jenkins-hbase4:44379] zookeeper.ReadOnlyZKClient(139): Connect 0x6cbc9d46 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:01:54,371 DEBUG [RS:2;jenkins-hbase4:44467] zookeeper.ReadOnlyZKClient(139): Connect 0x608cbf4b to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:01:54,375 DEBUG [RS:0;jenkins-hbase4:40079] zookeeper.ReadOnlyZKClient(139): Connect 0x25d1d127 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:01:54,380 DEBUG [RS:1;jenkins-hbase4:44379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627b6ea1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:01:54,381 DEBUG [RS:2;jenkins-hbase4:44467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e4b4d2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:01:54,381 DEBUG [RS:1;jenkins-hbase4:44379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6644f636, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 17:01:54,381 DEBUG [RS:2;jenkins-hbase4:44467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a74d43b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 17:01:54,381 DEBUG [RS:0;jenkins-hbase4:40079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b162bed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:01:54,382 DEBUG [RS:0;jenkins-hbase4:40079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a2b21d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 17:01:54,404 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44379 2023-09-22 17:01:54,409 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44467 2023-09-22 17:01:54,409 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40079 2023-09-22 17:01:54,410 INFO [RS:1;jenkins-hbase4:44379] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 17:01:54,410 INFO [RS:1;jenkins-hbase4:44379] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 17:01:54,410 INFO [RS:2;jenkins-hbase4:44467] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 17:01:54,410 INFO [RS:2;jenkins-hbase4:44467] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 17:01:54,410 INFO [RS:0;jenkins-hbase4:40079] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-22 17:01:54,410 INFO [RS:0;jenkins-hbase4:40079] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-22 17:01:54,410 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 17:01:54,411 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 17:01:54,410 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-22 17:01:54,411 INFO [RS:2;jenkins-hbase4:44467] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:54,412 INFO [RS:1;jenkins-hbase4:44379] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:54,412 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 17:01:54,411 INFO [RS:0;jenkins-hbase4:40079] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:54,412 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 17:01:54,412 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1022): About to register with Master. 2023-09-22 17:01:54,415 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33079,1695402111785 with isa=jenkins-hbase4.apache.org/172.31.14.131:44467, startcode=1695402113218 2023-09-22 17:01:54,415 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33079,1695402111785 with isa=jenkins-hbase4.apache.org/172.31.14.131:44379, startcode=1695402113177 2023-09-22 17:01:54,415 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33079,1695402111785 with isa=jenkins-hbase4.apache.org/172.31.14.131:40079, startcode=1695402113120 2023-09-22 17:01:54,435 DEBUG [RS:2;jenkins-hbase4:44467] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 17:01:54,435 DEBUG [RS:0;jenkins-hbase4:40079] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 17:01:54,435 DEBUG [RS:1;jenkins-hbase4:44379] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-22 17:01:54,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 17:01:54,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695402144456 2023-09-22 17:01:54,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-22 17:01:54,486 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-22 17:01:54,486 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-22 17:01:54,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-22 17:01:54,491 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 17:01:54,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-22 17:01:54,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-22 17:01:54,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-22 17:01:54,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-22 17:01:54,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-22 17:01:54,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-22 17:01:54,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-22 17:01:54,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-22 17:01:54,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-22 17:01:54,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695402114508,5,FailOnTimeoutGroup] 2023-09-22 17:01:54,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695402114509,5,FailOnTimeoutGroup] 2023-09-22 17:01:54,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-22 17:01:54,510 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52147, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 17:01:54,510 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50243, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 17:01:54,510 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49979, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-22 17:01:54,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,527 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33079] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,541 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-22 17:01:54,543 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-22 17:01:54,543 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:01:54,547 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33079] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,548 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33079] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,553 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:01:54,553 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:01:54,553 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44043 2023-09-22 17:01:54,554 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:01:54,554 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44043 2023-09-22 17:01:54,554 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44043 2023-09-22 17:01:54,554 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 17:01:54,554 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 17:01:54,554 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-22 17:01:54,564 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:01:54,566 DEBUG [RS:0;jenkins-hbase4:40079] zookeeper.ZKUtil(162): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,566 DEBUG [RS:1;jenkins-hbase4:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,567 WARN [RS:0;jenkins-hbase4:40079] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 17:01:54,567 INFO [RS:0;jenkins-hbase4:40079] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 17:01:54,567 DEBUG [RS:2;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,567 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,568 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40079,1695402113120] 2023-09-22 17:01:54,568 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44379,1695402113177] 2023-09-22 17:01:54,568 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44467,1695402113218] 2023-09-22 17:01:54,567 WARN [RS:1;jenkins-hbase4:44379] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 17:01:54,567 WARN [RS:2;jenkins-hbase4:44467] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-22 17:01:54,570 INFO [RS:1;jenkins-hbase4:44379] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 17:01:54,570 INFO [RS:2;jenkins-hbase4:44467] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 17:01:54,571 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,571 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,579 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:54,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-22 17:01:54,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/info 2023-09-22 17:01:54,584 DEBUG [RS:0;jenkins-hbase4:40079] zookeeper.ZKUtil(162): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,584 DEBUG [RS:2;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,585 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-22 17:01:54,585 DEBUG [RS:0;jenkins-hbase4:40079] zookeeper.ZKUtil(162): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,585 DEBUG [RS:2;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,586 DEBUG [RS:0;jenkins-hbase4:40079] zookeeper.ZKUtil(162): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,586 DEBUG [RS:2;jenkins-hbase4:44467] zookeeper.ZKUtil(162): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:54,587 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-22 17:01:54,587 DEBUG [RS:1;jenkins-hbase4:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,588 DEBUG [RS:1;jenkins-hbase4:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,589 DEBUG [RS:1;jenkins-hbase4:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/rep_barrier 2023-09-22 17:01:54,590 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-22 17:01:54,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:54,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-22 17:01:54,594 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/table 2023-09-22 17:01:54,595 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-22 17:01:54,596 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:54,598 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740 2023-09-22 17:01:54,600 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740 2023-09-22 17:01:54,601 DEBUG [RS:1;jenkins-hbase4:44379] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 17:01:54,601 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 17:01:54,601 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-22 17:01:54,606 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-22 17:01:54,609 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-22 17:01:54,613 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:01:54,614 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74711341, jitterRate=0.11328573524951935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-22 17:01:54,615 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-22 17:01:54,615 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-22 17:01:54,615 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-22 17:01:54,615 INFO [RS:1;jenkins-hbase4:44379] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 17:01:54,616 INFO [RS:0;jenkins-hbase4:40079] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 17:01:54,615 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-22 17:01:54,615 INFO [RS:2;jenkins-hbase4:44467] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-22 17:01:54,616 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-22 17:01:54,616 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-22 17:01:54,618 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-22 17:01:54,618 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-22 17:01:54,625 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-22 17:01:54,625 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-22 17:01:54,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-22 17:01:54,645 INFO [RS:0;jenkins-hbase4:40079] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 17:01:54,645 INFO [RS:1;jenkins-hbase4:44379] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 17:01:54,645 INFO [RS:2;jenkins-hbase4:44467] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-22 17:01:54,652 INFO [RS:1;jenkins-hbase4:44379] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 17:01:54,652 INFO [RS:2;jenkins-hbase4:44467] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 17:01:54,652 INFO [RS:0;jenkins-hbase4:40079] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-22 17:01:54,653 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,652 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,653 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,653 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-22 17:01:54,654 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 17:01:54,657 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 17:01:54,657 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-22 17:01:54,661 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-22 17:01:54,668 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,668 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,668 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,668 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,668 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,668 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,668 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,668 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,668 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:2;jenkins-hbase4:44467] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,668 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:0;jenkins-hbase4:40079] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,669 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,670 DEBUG [RS:1;jenkins-hbase4:44379] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-22 17:01:54,672 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,672 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,672 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,673 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,673 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,673 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,677 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,677 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,677 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,693 INFO [RS:1;jenkins-hbase4:44379] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 17:01:54,694 INFO [RS:0;jenkins-hbase4:40079] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 17:01:54,694 INFO [RS:2;jenkins-hbase4:44467] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-22 17:01:54,697 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40079,1695402113120-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,697 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44379,1695402113177-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,697 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44467,1695402113218-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:54,721 INFO [RS:0;jenkins-hbase4:40079] regionserver.Replication(203): jenkins-hbase4.apache.org,40079,1695402113120 started 2023-09-22 17:01:54,721 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40079,1695402113120, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40079, sessionid=0x100d49667260001 2023-09-22 17:01:54,721 INFO [RS:2;jenkins-hbase4:44467] regionserver.Replication(203): jenkins-hbase4.apache.org,44467,1695402113218 started 2023-09-22 17:01:54,721 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 17:01:54,721 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44467,1695402113218, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44467, sessionid=0x100d49667260003 2023-09-22 17:01:54,722 DEBUG [RS:0;jenkins-hbase4:40079] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,722 INFO [RS:1;jenkins-hbase4:44379] regionserver.Replication(203): jenkins-hbase4.apache.org,44379,1695402113177 started 2023-09-22 17:01:54,722 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 17:01:54,722 DEBUG [RS:0;jenkins-hbase4:40079] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40079,1695402113120' 2023-09-22 17:01:54,722 DEBUG [RS:2;jenkins-hbase4:44467] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,722 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44379,1695402113177, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44379, sessionid=0x100d49667260002 2023-09-22 17:01:54,723 DEBUG [RS:2;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44467,1695402113218' 2023-09-22 17:01:54,724 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-22 17:01:54,723 DEBUG [RS:0;jenkins-hbase4:40079] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 17:01:54,724 DEBUG [RS:1;jenkins-hbase4:44379] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,724 DEBUG [RS:1;jenkins-hbase4:44379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44379,1695402113177' 2023-09-22 17:01:54,725 DEBUG [RS:1;jenkins-hbase4:44379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 17:01:54,724 DEBUG [RS:2;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-22 17:01:54,725 DEBUG [RS:0;jenkins-hbase4:40079] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 17:01:54,725 DEBUG [RS:2;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 17:01:54,725 DEBUG [RS:1;jenkins-hbase4:44379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-22 17:01:54,726 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 17:01:54,726 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 17:01:54,726 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 17:01:54,726 DEBUG [RS:0;jenkins-hbase4:40079] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:54,726 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-22 17:01:54,726 DEBUG [RS:0;jenkins-hbase4:40079] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40079,1695402113120' 2023-09-22 17:01:54,727 DEBUG [RS:0;jenkins-hbase4:40079] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:01:54,726 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 17:01:54,726 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-22 17:01:54,727 DEBUG [RS:2;jenkins-hbase4:44467] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:54,727 DEBUG [RS:1;jenkins-hbase4:44379] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:01:54,727 DEBUG [RS:0;jenkins-hbase4:40079] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:01:54,727 DEBUG [RS:2;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44467,1695402113218' 2023-09-22 17:01:54,727 DEBUG [RS:1;jenkins-hbase4:44379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44379,1695402113177' 2023-09-22 17:01:54,728 DEBUG [RS:1;jenkins-hbase4:44379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:01:54,727 DEBUG [RS:2;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:01:54,728 DEBUG [RS:0;jenkins-hbase4:40079] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 17:01:54,728 INFO [RS:0;jenkins-hbase4:40079] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 17:01:54,728 INFO [RS:0;jenkins-hbase4:40079] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 17:01:54,728 DEBUG [RS:2;jenkins-hbase4:44467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:01:54,728 DEBUG [RS:1;jenkins-hbase4:44379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:01:54,729 DEBUG [RS:2;jenkins-hbase4:44467] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 17:01:54,729 INFO [RS:2;jenkins-hbase4:44467] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 17:01:54,729 DEBUG [RS:1;jenkins-hbase4:44379] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-22 17:01:54,729 INFO [RS:2;jenkins-hbase4:44467] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 17:01:54,729 INFO [RS:1;jenkins-hbase4:44379] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-22 17:01:54,729 INFO [RS:1;jenkins-hbase4:44379] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-22 17:01:54,813 DEBUG [jenkins-hbase4:33079] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-22 17:01:54,817 DEBUG [jenkins-hbase4:33079] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:01:54,823 DEBUG [jenkins-hbase4:33079] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:01:54,824 DEBUG [jenkins-hbase4:33079] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:01:54,824 DEBUG [jenkins-hbase4:33079] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:01:54,824 DEBUG [jenkins-hbase4:33079] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:01:54,827 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40079,1695402113120, state=OPENING 2023-09-22 17:01:54,836 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-22 17:01:54,838 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:54,838 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-22 17:01:54,841 INFO [RS:1;jenkins-hbase4:44379] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44379%2C1695402113177, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,44379,1695402113177, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs, maxLogs=32 2023-09-22 17:01:54,842 INFO [RS:2;jenkins-hbase4:44467] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44467%2C1695402113218, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,44467,1695402113218, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs, maxLogs=32 2023-09-22 17:01:54,843 INFO [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40079%2C1695402113120, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,40079,1695402113120, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs, maxLogs=32 2023-09-22 17:01:54,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:01:54,874 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK] 2023-09-22 17:01:54,874 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK] 2023-09-22 17:01:54,880 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK] 2023-09-22 17:01:54,881 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK] 2023-09-22 17:01:54,883 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK] 2023-09-22 17:01:54,884 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK] 2023-09-22 17:01:54,884 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK] 2023-09-22 17:01:54,884 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK] 2023-09-22 17:01:54,890 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK] 2023-09-22 17:01:54,897 INFO [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,40079,1695402113120/jenkins-hbase4.apache.org%2C40079%2C1695402113120.1695402114846 2023-09-22 17:01:54,898 DEBUG [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK], DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK], DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK]] 2023-09-22 17:01:54,898 INFO [RS:1;jenkins-hbase4:44379] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,44379,1695402113177/jenkins-hbase4.apache.org%2C44379%2C1695402113177.1695402114846 2023-09-22 17:01:54,898 DEBUG [RS:1;jenkins-hbase4:44379] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK], DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK], DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK]] 2023-09-22 17:01:54,898 INFO [RS:2;jenkins-hbase4:44467] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,44467,1695402113218/jenkins-hbase4.apache.org%2C44467%2C1695402113218.1695402114846 2023-09-22 17:01:54,899 DEBUG [RS:2;jenkins-hbase4:44467] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK], DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK], DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK]] 2023-09-22 17:01:55,035 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:55,037 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 17:01:55,041 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 17:01:55,055 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-22 17:01:55,055 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-22 17:01:55,059 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40079%2C1695402113120.meta, suffix=.meta, logDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,40079,1695402113120, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs, maxLogs=32 2023-09-22 17:01:55,079 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK] 2023-09-22 17:01:55,080 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK] 2023-09-22 17:01:55,082 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK] 2023-09-22 17:01:55,089 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/WALs/jenkins-hbase4.apache.org,40079,1695402113120/jenkins-hbase4.apache.org%2C40079%2C1695402113120.meta.1695402115060.meta 2023-09-22 17:01:55,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44577,DS-7e9299ec-6f47-4299-8729-8068e374e92a,DISK], DatanodeInfoWithStorage[127.0.0.1:45357,DS-e09c84ce-309f-4647-881e-a778c075779d,DISK], DatanodeInfoWithStorage[127.0.0.1:45691,DS-9b2843d9-5441-4e5e-8ae4-422430d5b65a,DISK]] 2023-09-22 17:01:55,090 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-22 17:01:55,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-22 17:01:55,092 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:55,093 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-22 17:01:55,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-22 17:01:55,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-22 17:01:55,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-22 17:01:55,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:55,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-22 17:01:55,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-22 17:01:55,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-22 17:01:55,115 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/info 2023-09-22 17:01:55,115 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/info 2023-09-22 17:01:55,115 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-22 17:01:55,116 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:55,116 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-22 17:01:55,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/rep_barrier 2023-09-22 17:01:55,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/rep_barrier 2023-09-22 17:01:55,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-22 17:01:55,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:55,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-22 17:01:55,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/table 2023-09-22 17:01:55,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/table 2023-09-22 17:01:55,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-22 17:01:55,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:55,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740 2023-09-22 17:01:55,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740 2023-09-22 17:01:55,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-22 17:01:55,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-22 17:01:55,136 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61634854, jitterRate=-0.08156910538673401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-22 17:01:55,138 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-22 17:01:55,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695402115027 2023-09-22 17:01:55,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-22 17:01:55,168 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-22 17:01:55,168 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40079,1695402113120, state=OPEN 2023-09-22 17:01:55,171 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-22 17:01:55,171 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-22 17:01:55,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-22 17:01:55,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40079,1695402113120 in 327 msec 2023-09-22 17:01:55,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-22 17:01:55,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2023-09-22 17:01:55,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 828 msec 2023-09-22 17:01:55,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695402115187, completionTime=-1 2023-09-22 17:01:55,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-22 17:01:55,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-22 17:01:55,257 DEBUG [hconnection-0x3e5b8d5d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:01:55,260 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:01:55,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-22 17:01:55,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695402175281 2023-09-22 17:01:55,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695402235281 2023-09-22 17:01:55,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 92 msec 2023-09-22 17:01:55,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33079,1695402111785-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:55,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33079,1695402111785-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:55,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33079,1695402111785-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:55,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33079, period=300000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:55,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-22 17:01:55,317 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-22 17:01:55,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-22 17:01:55,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 17:01:55,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-22 17:01:55,340 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:01:55,343 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:01:55,365 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/namespace/98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,368 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/namespace/98bbded44a602da5054b9c48041738c8 empty. 2023-09-22 17:01:55,369 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/namespace/98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,369 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-22 17:01:55,407 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-22 17:01:55,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 98bbded44a602da5054b9c48041738c8, NAME => 'hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:01:55,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:55,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 98bbded44a602da5054b9c48041738c8, disabling compactions & flushes 2023-09-22 17:01:55,437 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. after waiting 0 ms 2023-09-22 17:01:55,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,438 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 98bbded44a602da5054b9c48041738c8: 2023-09-22 17:01:55,443 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:01:55,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695402115447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402115447"}]},"ts":"1695402115447"} 2023-09-22 17:01:55,497 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-22 17:01:55,499 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:01:55,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402115499"}]},"ts":"1695402115499"} 2023-09-22 17:01:55,508 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-22 17:01:55,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:01:55,513 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:01:55,513 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:01:55,513 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:01:55,513 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:01:55,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=98bbded44a602da5054b9c48041738c8, ASSIGN}] 2023-09-22 17:01:55,519 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=98bbded44a602da5054b9c48041738c8, ASSIGN 2023-09-22 17:01:55,520 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=98bbded44a602da5054b9c48041738c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1695402113218; forceNewPlan=false, retain=false 2023-09-22 17:01:55,673 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 17:01:55,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=98bbded44a602da5054b9c48041738c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:55,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695402115674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402115674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402115674"}]},"ts":"1695402115674"} 2023-09-22 17:01:55,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 98bbded44a602da5054b9c48041738c8, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:01:55,837 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:55,837 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 17:01:55,842 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 17:01:55,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98bbded44a602da5054b9c48041738c8, NAME => 'hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.', STARTKEY => '', ENDKEY => ''} 2023-09-22 17:01:55,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. service=AccessControlService 2023-09-22 17:01:55,851 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:55,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:55,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,854 INFO [StoreOpener-98bbded44a602da5054b9c48041738c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,857 DEBUG [StoreOpener-98bbded44a602da5054b9c48041738c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/info 2023-09-22 17:01:55,857 DEBUG [StoreOpener-98bbded44a602da5054b9c48041738c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/info 2023-09-22 17:01:55,857 INFO [StoreOpener-98bbded44a602da5054b9c48041738c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98bbded44a602da5054b9c48041738c8 columnFamilyName info 2023-09-22 17:01:55,859 INFO [StoreOpener-98bbded44a602da5054b9c48041738c8-1] regionserver.HStore(310): Store=98bbded44a602da5054b9c48041738c8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:55,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98bbded44a602da5054b9c48041738c8 2023-09-22 17:01:55,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:01:55,871 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98bbded44a602da5054b9c48041738c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62712020, jitterRate=-0.0655180811882019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:01:55,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98bbded44a602da5054b9c48041738c8: 2023-09-22 17:01:55,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8., pid=6, masterSystemTime=1695402115837 2023-09-22 17:01:55,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,878 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:01:55,879 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=98bbded44a602da5054b9c48041738c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:01:55,880 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695402115879"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402115879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402115879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402115879"}]},"ts":"1695402115879"} 2023-09-22 17:01:55,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-22 17:01:55,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 98bbded44a602da5054b9c48041738c8, server=jenkins-hbase4.apache.org,44467,1695402113218 in 202 msec 2023-09-22 17:01:55,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-22 17:01:55,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=98bbded44a602da5054b9c48041738c8, ASSIGN in 371 msec 2023-09-22 17:01:55,895 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:01:55,896 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402115896"}]},"ts":"1695402115896"} 2023-09-22 17:01:55,898 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-22 17:01:55,903 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:01:55,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 577 msec 2023-09-22 17:01:55,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-22 17:01:55,943 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-22 17:01:55,943 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:01:55,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:01:55,971 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:01:55,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-22 17:01:55,999 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-22 17:01:56,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-09-22 17:01:56,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-22 17:01:56,029 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-22 17:01:56,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-22 17:01:56,043 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-22 17:01:56,046 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-22 17:01:56,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.768sec 2023-09-22 17:01:56,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-22 17:01:56,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-22 17:01:56,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-22 17:01:56,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33079,1695402111785-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-22 17:01:56,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33079,1695402111785-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-22 17:01:56,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-22 17:01:56,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-22 17:01:56,088 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:01:56,090 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:01:56,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-22 17:01:56,093 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,094 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2 empty. 2023-09-22 17:01:56,097 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,097 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-22 17:01:56,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 17:01:56,120 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-22 17:01:56,122 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 64c2b6478c2f8e5f520ee2637307e0b2, NAME => 'hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:01:56,148 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:56,148 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 64c2b6478c2f8e5f520ee2637307e0b2, disabling compactions & flushes 2023-09-22 17:01:56,148 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,148 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,148 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. after waiting 0 ms 2023-09-22 17:01:56,148 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,148 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,148 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 64c2b6478c2f8e5f520ee2637307e0b2: 2023-09-22 17:01:56,149 DEBUG [Listener at localhost/37331] zookeeper.ReadOnlyZKClient(139): Connect 0x782e04b0 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:01:56,155 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:01:56,155 DEBUG [Listener at localhost/37331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10016256, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:01:56,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695402116156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402116156"}]},"ts":"1695402116156"} 2023-09-22 17:01:56,160 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-22 17:01:56,162 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:01:56,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402116163"}]},"ts":"1695402116163"} 2023-09-22 17:01:56,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-22 17:01:56,171 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:01:56,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:01:56,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:01:56,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:01:56,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:01:56,172 DEBUG [hconnection-0x4e0a2980-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:01:56,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=64c2b6478c2f8e5f520ee2637307e0b2, ASSIGN}] 2023-09-22 17:01:56,175 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=64c2b6478c2f8e5f520ee2637307e0b2, ASSIGN 2023-09-22 17:01:56,176 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=64c2b6478c2f8e5f520ee2637307e0b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40079,1695402113120; forceNewPlan=false, retain=false 2023-09-22 17:01:56,186 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:01:56,188 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:01:56,188 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-22 17:01:56,188 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/test.cache.data in system properties and HBase conf 2023-09-22 17:01:56,188 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop.tmp.dir in system properties and HBase conf 2023-09-22 17:01:56,188 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop.log.dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 17:01:56,189 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-22 17:01:56,190 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/nfs.dump.dir in system properties and HBase conf 2023-09-22 17:01:56,190 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir in system properties and HBase conf 2023-09-22 17:01:56,190 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-22 17:01:56,190 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-22 17:01:56,190 INFO [Listener at localhost/37331] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-22 17:01:56,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 17:01:56,326 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 17:01:56,328 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=64c2b6478c2f8e5f520ee2637307e0b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:56,328 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695402116327"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402116327"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402116327"}]},"ts":"1695402116327"} 2023-09-22 17:01:56,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 64c2b6478c2f8e5f520ee2637307e0b2, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:01:56,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 17:01:56,493 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64c2b6478c2f8e5f520ee2637307e0b2, NAME => 'hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.', STARTKEY => '', ENDKEY => ''} 2023-09-22 17:01:56,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. service=AccessControlService 2023-09-22 17:01:56,494 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:01:56,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:01:56,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,497 INFO [StoreOpener-64c2b6478c2f8e5f520ee2637307e0b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,499 DEBUG [StoreOpener-64c2b6478c2f8e5f520ee2637307e0b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/l 2023-09-22 17:01:56,499 DEBUG [StoreOpener-64c2b6478c2f8e5f520ee2637307e0b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/l 2023-09-22 17:01:56,500 INFO [StoreOpener-64c2b6478c2f8e5f520ee2637307e0b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64c2b6478c2f8e5f520ee2637307e0b2 columnFamilyName l 2023-09-22 17:01:56,501 INFO [StoreOpener-64c2b6478c2f8e5f520ee2637307e0b2-1] regionserver.HStore(310): Store=64c2b6478c2f8e5f520ee2637307e0b2/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:01:56,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:01:56,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:01:56,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 64c2b6478c2f8e5f520ee2637307e0b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72504359, jitterRate=0.08039914071559906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:01:56,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 64c2b6478c2f8e5f520ee2637307e0b2: 2023-09-22 17:01:56,516 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2., pid=11, masterSystemTime=1695402116485 2023-09-22 17:01:56,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:01:56,520 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=64c2b6478c2f8e5f520ee2637307e0b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:01:56,520 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695402116520"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402116520"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402116520"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402116520"}]},"ts":"1695402116520"} 2023-09-22 17:01:56,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-22 17:01:56,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 64c2b6478c2f8e5f520ee2637307e0b2, server=jenkins-hbase4.apache.org,40079,1695402113120 in 192 msec 2023-09-22 17:01:56,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-22 17:01:56,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=64c2b6478c2f8e5f520ee2637307e0b2, ASSIGN in 355 msec 2023-09-22 17:01:56,535 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:01:56,535 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402116535"}]},"ts":"1695402116535"} 2023-09-22 17:01:56,538 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-22 17:01:56,542 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:01:56,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 458 msec 2023-09-22 17:01:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-22 17:01:56,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-22 17:01:56,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-22 17:01:57,437 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:01:57,784 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:01:57,790 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46821_jobhistory____.htfqa/webapp 2023-09-22 17:01:57,967 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-22 17:01:57,967 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-22 17:01:57,967 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 17:01:57,970 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 17:01:58,068 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:01:58,402 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:01:58,749 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-22 17:01:58,787 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46821 2023-09-22 17:01:58,929 WARN [Listener at jenkins-hbase4.apache.org/36613] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:01:59,189 WARN [Listener at jenkins-hbase4.apache.org/36613] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 17:01:59,190 INFO [Listener at jenkins-hbase4.apache.org/36613] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:01:59,199 INFO [Listener at jenkins-hbase4.apache.org/36613] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37315_cluster____.biesxb/webapp 2023-09-22 17:01:59,275 INFO [Listener at jenkins-hbase4.apache.org/36613] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 17:01:59,275 INFO [Listener at jenkins-hbase4.apache.org/36613] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-22 17:01:59,275 INFO [Listener at jenkins-hbase4.apache.org/36613] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 17:01:59,276 INFO [Listener at jenkins-hbase4.apache.org/36613] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 17:01:59,285 INFO [Listener at jenkins-hbase4.apache.org/36613] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:01:59,470 INFO [Listener at jenkins-hbase4.apache.org/36613] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:01:59,555 INFO [Listener at jenkins-hbase4.apache.org/36613] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:01:59,562 INFO [Listener at jenkins-hbase4.apache.org/36613] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37315 2023-09-22 17:02:00,010 WARN [Listener at jenkins-hbase4.apache.org/42763] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:02:00,037 WARN [Listener at jenkins-hbase4.apache.org/42763] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 17:02:00,038 INFO [Listener at jenkins-hbase4.apache.org/42763] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:02:00,045 INFO [Listener at jenkins-hbase4.apache.org/42763] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46277_node____.iokdma/webapp 2023-09-22 17:02:00,097 INFO [Listener at jenkins-hbase4.apache.org/42763] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-22 17:02:00,097 INFO [Listener at jenkins-hbase4.apache.org/42763] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 17:02:00,097 INFO [Listener at jenkins-hbase4.apache.org/42763] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 17:02:00,097 INFO [Listener at jenkins-hbase4.apache.org/42763] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 17:02:00,106 INFO [Listener at jenkins-hbase4.apache.org/42763] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:02:00,141 INFO [Listener at jenkins-hbase4.apache.org/42763] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:02:00,239 INFO [Listener at jenkins-hbase4.apache.org/42763] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:02:00,250 INFO [Listener at jenkins-hbase4.apache.org/42763] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46277 2023-09-22 17:02:00,410 WARN [Listener at jenkins-hbase4.apache.org/44767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-22 17:02:00,416 WARN [Listener at jenkins-hbase4.apache.org/44767] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-22 17:02:00,417 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): jetty-6.1.26 2023-09-22 17:02:00,423 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35541_node____cy8u8e/webapp 2023-09-22 17:02:00,475 INFO [Listener at jenkins-hbase4.apache.org/44767] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-22 17:02:00,475 INFO [Listener at jenkins-hbase4.apache.org/44767] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-22 17:02:00,475 INFO [Listener at jenkins-hbase4.apache.org/44767] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-22 17:02:00,475 INFO [Listener at jenkins-hbase4.apache.org/44767] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-22 17:02:00,485 INFO [Listener at jenkins-hbase4.apache.org/44767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:02:00,501 INFO [Listener at jenkins-hbase4.apache.org/44767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:02:00,579 INFO [Listener at jenkins-hbase4.apache.org/44767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-22 17:02:00,584 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35541 2023-09-22 17:02:00,609 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-22 17:02:00,611 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:00,665 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:02:00,688 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=165, AvailableMemoryMB=2065 2023-09-22 17:02:00,689 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-09-22 17:02:00,720 DEBUG [Listener at jenkins-hbase4.apache.org/44767] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-22 17:02:00,726 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-22 17:02:00,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 17:02:00,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:00,746 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:02:00,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-22 17:02:00,750 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:02:00,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 17:02:00,756 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:00,756 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:00,757 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 empty. 2023-09-22 17:02:00,757 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b empty. 2023-09-22 17:02:00,758 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:00,758 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:00,758 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-22 17:02:00,806 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-22 17:02:00,811 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 70aff4de89d0651e85104baa2e6f078b, NAME => 'testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:02:00,811 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a6f4f877b2377fbdae5ac3044e5256c1, NAME => 'testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:02:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 17:02:00,871 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-22 17:02:00,876 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-22 17:02:00,878 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 70aff4de89d0651e85104baa2e6f078b, disabling compactions & flushes 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a6f4f877b2377fbdae5ac3044e5256c1, disabling compactions & flushes 2023-09-22 17:02:00,884 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:00,884 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. after waiting 0 ms 2023-09-22 17:02:00,884 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. after waiting 0 ms 2023-09-22 17:02:00,885 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:00,885 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:00,885 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:00,885 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:00,885 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 70aff4de89d0651e85104baa2e6f078b: 2023-09-22 17:02:00,885 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a6f4f877b2377fbdae5ac3044e5256c1: 2023-09-22 17:02:00,889 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:02:00,890 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402120890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402120890"}]},"ts":"1695402120890"} 2023-09-22 17:02:00,890 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402120890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402120890"}]},"ts":"1695402120890"} 2023-09-22 17:02:00,942 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:02:00,943 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:02:00,944 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402120943"}]},"ts":"1695402120943"} 2023-09-22 17:02:00,946 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-22 17:02:00,951 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:02:00,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:02:00,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:02:00,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:02:00,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:02:00,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, ASSIGN}] 2023-09-22 17:02:00,956 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, ASSIGN 2023-09-22 17:02:00,956 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, ASSIGN 2023-09-22 17:02:00,957 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44379,1695402113177; forceNewPlan=false, retain=false 2023-09-22 17:02:00,957 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40079,1695402113120; forceNewPlan=false, retain=false 2023-09-22 17:02:01,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 17:02:01,108 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:02:01,110 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a6f4f877b2377fbdae5ac3044e5256c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:01,110 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=70aff4de89d0651e85104baa2e6f078b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:01,110 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402121110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402121110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402121110"}]},"ts":"1695402121110"} 2023-09-22 17:02:01,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402121110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402121110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402121110"}]},"ts":"1695402121110"} 2023-09-22 17:02:01,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure a6f4f877b2377fbdae5ac3044e5256c1, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:02:01,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 70aff4de89d0651e85104baa2e6f078b, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:02:01,267 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:01,267 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 17:02:01,271 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 17:02:01,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70aff4de89d0651e85104baa2e6f078b, NAME => 'testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. service=AccessControlService 2023-09-22 17:02:01,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:01,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a6f4f877b2377fbdae5ac3044e5256c1, NAME => 'testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. service=AccessControlService 2023-09-22 17:02:01,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:02:01,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:01,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,280 INFO [StoreOpener-70aff4de89d0651e85104baa2e6f078b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,280 INFO [StoreOpener-a6f4f877b2377fbdae5ac3044e5256c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,282 DEBUG [StoreOpener-a6f4f877b2377fbdae5ac3044e5256c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf 2023-09-22 17:02:01,283 DEBUG [StoreOpener-a6f4f877b2377fbdae5ac3044e5256c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf 2023-09-22 17:02:01,283 DEBUG [StoreOpener-70aff4de89d0651e85104baa2e6f078b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf 2023-09-22 17:02:01,283 DEBUG [StoreOpener-70aff4de89d0651e85104baa2e6f078b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf 2023-09-22 17:02:01,287 INFO [StoreOpener-70aff4de89d0651e85104baa2e6f078b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70aff4de89d0651e85104baa2e6f078b columnFamilyName cf 2023-09-22 17:02:01,287 INFO [StoreOpener-a6f4f877b2377fbdae5ac3044e5256c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6f4f877b2377fbdae5ac3044e5256c1 columnFamilyName cf 2023-09-22 17:02:01,290 INFO [StoreOpener-a6f4f877b2377fbdae5ac3044e5256c1-1] regionserver.HStore(310): Store=a6f4f877b2377fbdae5ac3044e5256c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:02:01,290 INFO [StoreOpener-70aff4de89d0651e85104baa2e6f078b-1] regionserver.HStore(310): Store=70aff4de89d0651e85104baa2e6f078b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:02:01,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:01,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:01,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:02:01,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:02:01,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 70aff4de89d0651e85104baa2e6f078b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65871333, jitterRate=-0.018440648913383484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:02:01,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 70aff4de89d0651e85104baa2e6f078b: 2023-09-22 17:02:01,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b., pid=16, masterSystemTime=1695402121267 2023-09-22 17:02:01,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:01,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:01,308 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=70aff4de89d0651e85104baa2e6f078b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:01,309 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402121308"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402121308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402121308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402121308"}]},"ts":"1695402121308"} 2023-09-22 17:02:01,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a6f4f877b2377fbdae5ac3044e5256c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62964526, jitterRate=-0.06175544857978821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:02:01,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a6f4f877b2377fbdae5ac3044e5256c1: 2023-09-22 17:02:01,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1., pid=15, masterSystemTime=1695402121267 2023-09-22 17:02:01,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:01,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:01,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a6f4f877b2377fbdae5ac3044e5256c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:01,324 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402121323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402121323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402121323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402121323"}]},"ts":"1695402121323"} 2023-09-22 17:02:01,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-22 17:02:01,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 70aff4de89d0651e85104baa2e6f078b, server=jenkins-hbase4.apache.org,40079,1695402113120 in 202 msec 2023-09-22 17:02:01,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, ASSIGN in 372 msec 2023-09-22 17:02:01,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-22 17:02:01,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure a6f4f877b2377fbdae5ac3044e5256c1, server=jenkins-hbase4.apache.org,44379,1695402113177 in 215 msec 2023-09-22 17:02:01,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-22 17:02:01,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, ASSIGN in 381 msec 2023-09-22 17:02:01,339 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:02:01,340 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402121339"}]},"ts":"1695402121339"} 2023-09-22 17:02:01,342 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-22 17:02:01,345 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:02:01,350 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-22 17:02:01,368 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 17:02:01,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 17:02:01,400 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:01,400 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:01,400 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:02:01,400 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:01,400 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:01,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:01,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:01,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:01,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:01,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 670 msec 2023-09-22 17:02:01,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-22 17:02:01,877 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-22 17:02:01,882 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-22 17:02:01,883 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:01,886 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:01,912 DEBUG [hconnection-0x4e0a2980-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:01,918 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:01,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 17:02:01,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402121932 (current time:1695402121932). 2023-09-22 17:02:01,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:02:01,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x56015790 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:01,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a95cab5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:01,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:01,946 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:01,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56015790 to 127.0.0.1:51340 2023-09-22 17:02:01,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:01,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x164a8796 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:01,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@702e11a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:01,959 DEBUG [hconnection-0x53fd4e74-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:01,961 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:01,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x164a8796 to 127.0.0.1:51340 2023-09-22 17:02:01,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:01,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 17:02:01,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:02:01,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 17:02:01,995 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:01,996 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-22 17:02:01,996 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:01,996 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-22 17:02:01,997 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-22 17:02:01,997 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-22 17:02:01,997 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:01,997 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-22 17:02:01,997 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-22 17:02:01,997 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-22 17:02:02,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 17:02:02,011 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 17:02:02,013 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695402722013 2023-09-22 17:02:02,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 17:02:02,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-22 17:02:02,016 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 17:02:02,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 17:02:02,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-22 17:02:02,021 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 17:02:02,021 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:02:02,022 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:02:02,022 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695402722022 2023-09-22 17:02:02,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,057 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-22 17:02:02,058 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,059 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-22 17:02:02,059 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-22 17:02:02,059 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,059 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,066 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,066 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,066 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,066 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,066 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,066 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,067 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,067 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:02:02,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 17:02:02,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 17:02:02,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 17:02:02,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 17:02:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 17:02:02,080 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,080 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,080 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 17:02:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 17:02:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 17:02:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 17:02:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 17:02:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 17:02:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 17:02:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,082 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 17:02:02,082 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-22 17:02:02,082 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-22 17:02:02,084 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,084 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,085 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,085 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,085 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,085 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:02,085 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,086 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,086 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:02,086 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,086 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-22 17:02:02,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@292645b7[Count = 1] remaining members to acquire global barrier 2023-09-22 17:02:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-22 17:02:02,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@292645b7[Count = 0] remaining members to acquire global barrier 2023-09-22 17:02:02,091 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-22 17:02:02,091 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,094 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,094 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,094 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,095 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 17:02:02,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,095 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 17:02:02,095 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 17:02:02,095 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,095 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 17:02:02,095 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:02:02,095 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,096 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:02:02,096 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:02,096 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:02,096 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:02,096 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:02,096 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:02,096 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:02,097 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. started... 2023-09-22 17:02:02,097 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. started... 2023-09-22 17:02:02,098 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 17:02:02,099 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:02,099 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 17:02:02,101 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6f4f877b2377fbdae5ac3044e5256c1: 2023-09-22 17:02:02,101 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70aff4de89d0651e85104baa2e6f078b: 2023-09-22 17:02:02,102 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,102 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,108 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:02,108 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:02,111 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:02:02,111 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:02:02,122 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:02,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 17:02:02,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:02,138 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. completed. 2023-09-22 17:02:02,138 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:02,139 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:02:02,139 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. completed. 2023-09-22 17:02:02,139 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:02,139 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:02,139 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:02:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:02:02,142 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 17:02:02,142 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,142 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 17:02:02,142 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,142 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:02,142 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 17:02:02,142 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:02,143 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-22 17:02:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:02:02,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-22 17:02:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:02:02,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-22 17:02:02,153 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-22 17:02:02,153 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:02:02,153 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:02:02,153 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,153 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:02,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:02,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:02,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:02,159 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,160 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,161 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,163 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,163 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,164 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,178 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,178 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,178 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,179 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:02,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-22 17:02:02,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,178 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:02:02,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:02,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,179 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:02,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,180 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,180 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:02,181 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,181 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,181 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,181 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:02,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:02,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:02,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 17:02:02,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:02,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-22 17:02:02,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,262 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:02,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695402122013Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695402122205 (+192 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695402122205Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695402122206 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695402122222 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695402122248 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695402122261 (+13 ms) 2023-09-22 17:02:02,264 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 17:02:02,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 251 msec 2023-09-22 17:02:02,339 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:02,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 17:02:02,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:02:02,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40079] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:02:02,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:02:02,365 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-22 17:02:02,365 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:02,366 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:02,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 17:02:02,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402122381 (current time:1695402122381). 2023-09-22 17:02:02,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:02:02,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x04500160 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:02,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a217822, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:02,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:02,391 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:02,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04500160 to 127.0.0.1:51340 2023-09-22 17:02:02,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:02,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x40edf6fc to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:02,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4432a480, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:02,400 DEBUG [hconnection-0x2533344c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:02,402 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:02,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40edf6fc to 127.0.0.1:51340 2023-09-22 17:02:02,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:02,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-22 17:02:02,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:02:02,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 17:02:02,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 17:02:02,414 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 17:02:02,415 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695402722415 2023-09-22 17:02:02,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-22 17:02:02,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-22 17:02:02,417 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:02:02,417 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:02:02,418 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-22 17:02:02,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 17:02:02,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-22 17:02:02,421 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 17:02:02,422 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695402722422 2023-09-22 17:02:02,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-22 17:02:02,439 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-22 17:02:02,439 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,440 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-22 17:02:02,440 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-22 17:02:02,440 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,440 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,443 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,443 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,443 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,443 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,443 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,443 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,444 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,444 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 17:02:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 17:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 17:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-22 17:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,446 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 17:02:02,446 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 17:02:02,446 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 17:02:02,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-22 17:02:02,447 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 17:02:02,447 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 17:02:02,447 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-22 17:02:02,447 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:02,447 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 17:02:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-22 17:02:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-22 17:02:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-22 17:02:02,451 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,451 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,452 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,452 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,454 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799cd08[Count = 1] remaining members to acquire global barrier 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:02,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-22 17:02:02,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799cd08[Count = 0] remaining members to acquire global barrier 2023-09-22 17:02:02,459 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-22 17:02:02,459 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 17:02:02,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 17:02:02,464 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:02,463 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,464 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. started... 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:02:02,464 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a6f4f877b2377fbdae5ac3044e5256c1 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:02,464 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,464 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:02:02,464 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:02,465 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. started... 2023-09-22 17:02:02,465 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 70aff4de89d0651e85104baa2e6f078b 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-22 17:02:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 17:02:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 17:02:02,517 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:02,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 17:02:02,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:02,519 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:02:02,604 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309227e97ccc5f4e74bee97d23fa7d41b8770 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309227e97ccc5f4e74bee97d23fa7d41b8770 2023-09-22 17:02:02,604 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922520d617731f04851b4d391652c054ea1 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922520d617731f04851b4d391652c054ea1 2023-09-22 17:02:02,641 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/.tmp/cf/0c06f39877bb46419d3bfe076e150b4b 2023-09-22 17:02:02,642 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/.tmp/cf/140879118cfb4b76a8579f2730a4acad 2023-09-22 17:02:02,653 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/.tmp/cf/140879118cfb4b76a8579f2730a4acad as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf/140879118cfb4b76a8579f2730a4acad 2023-09-22 17:02:02,653 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/.tmp/cf/0c06f39877bb46419d3bfe076e150b4b as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf/0c06f39877bb46419d3bfe076e150b4b 2023-09-22 17:02:02,663 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf/0c06f39877bb46419d3bfe076e150b4b, entries=4, sequenceid=6, filesize=5.6 K 2023-09-22 17:02:02,663 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf/140879118cfb4b76a8579f2730a4acad, entries=46, sequenceid=6, filesize=12.6 K 2023-09-22 17:02:02,667 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 70aff4de89d0651e85104baa2e6f078b in 202ms, sequenceid=6, compaction requested=false 2023-09-22 17:02:02,667 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a6f4f877b2377fbdae5ac3044e5256c1 in 203ms, sequenceid=6, compaction requested=false 2023-09-22 17:02:02,668 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-22 17:02:02,668 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6f4f877b2377fbdae5ac3044e5256c1: 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70aff4de89d0651e85104baa2e6f078b: 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf/140879118cfb4b76a8579f2730a4acad] hfiles 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:02,670 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf/140879118cfb4b76a8579f2730a4acad for snapshot=snaptb0-testExportWithTargetName 2023-09-22 17:02:02,671 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf/0c06f39877bb46419d3bfe076e150b4b] hfiles 2023-09-22 17:02:02,671 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf/0c06f39877bb46419d3bfe076e150b4b for snapshot=snaptb0-testExportWithTargetName 2023-09-22 17:02:02,695 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. completed. 2023-09-22 17:02:02,696 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:02,696 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:02,696 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:02,696 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,696 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 17:02:02,696 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:02:02,698 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,698 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 17:02:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:02,699 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 17:02:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:02,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:02:02,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-22 17:02:02,719 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:02,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 17:02:02,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:02,721 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-22 17:02:03,021 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:03,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 17:02:03,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:03,022 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-22 17:02:03,095 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. completed. 2023-09-22 17:02:03,095 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-22 17:02:03,095 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:02:03,097 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,097 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-22 17:02:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,097 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:03,097 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-22 17:02:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:02:03,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-22 17:02:03,104 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-22 17:02:03,104 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:02:03,104 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:02:03,104 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-22 17:02:03,104 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:02:03,106 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:03,106 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:03,106 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,106 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:03,107 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:03,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:03,107 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:03,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:03,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,108 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:03,108 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:03,111 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-22 17:02:03,111 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,111 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,122 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:03,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:03,123 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:03,123 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:03,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:03,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-22 17:02:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:03,124 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-22 17:02:03,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:03,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:02:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:03,125 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:03,125 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,125 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:03,125 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:03,125 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,125 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922520d617731f04851b4d391652c054ea1, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309227e97ccc5f4e74bee97d23fa7d41b8770] mob files 2023-09-22 17:02:03,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922520d617731f04851b4d391652c054ea1 2023-09-22 17:02:03,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309227e97ccc5f4e74bee97d23fa7d41b8770 2023-09-22 17:02:03,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-22 17:02:03,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-22 17:02:03,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,186 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-22 17:02:03,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695402122416Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695402123141 (+725 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695402123141Loading Region manifests for snaptb0-testExportWithTargetName at 1695402123142 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1695402123148 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695402123173 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695402123185 (+12 ms) 2023-09-22 17:02:03,188 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-22 17:02:03,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 772 msec 2023-09-22 17:02:03,523 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:03,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-22 17:02:03,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:02:03,526 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526 2023-09-22 17:02:03,527 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44043, tgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526, rawTgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:03,567 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:03,567 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1678502194_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-22 17:02:03,567 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-22 17:02:03,588 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-22 17:02:03,645 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:03,645 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:03,646 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:03,646 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,581 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-5128422541252060666.jar 2023-09-22 17:02:04,581 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,582 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,651 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-5092907694629976254.jar 2023-09-22 17:02:04,652 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,652 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,653 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,653 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,653 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,654 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:04,654 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:02:04,655 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:02:04,655 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:02:04,656 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:02:04,656 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:02:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:02:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:02:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:02:04,658 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:02:04,658 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:02:04,662 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:04,662 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:04,664 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:04,664 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:05,494 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:02:05,500 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-22 17:02:05,508 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-22 17:02:05,973 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:05,975 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:06,521 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0001_000001 (auth:SIMPLE) 2023-09-22 17:02:06,782 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:02:10,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0001_000001 (auth:SIMPLE) 2023-09-22 17:02:13,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0001_000001 (auth:SIMPLE) 2023-09-22 17:02:15,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0001_000001 (auth:SIMPLE) 2023-09-22 17:02:17,347 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:02:17,350 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:02:17,365 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-22 17:02:17,365 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:02:17,366 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:02:17,366 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-22 17:02:17,366 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-22 17:02:17,367 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-22 17:02:17,367 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526/.hbase-snapshot/testExportWithTargetName 2023-09-22 17:02:17,367 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-22 17:02:17,367 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402123526/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-22 17:02:17,377 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-22 17:02:17,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-22 17:02:17,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402137397"}]},"ts":"1695402137397"} 2023-09-22 17:02:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 17:02:17,399 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-22 17:02:17,402 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-22 17:02:17,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, UNASSIGN}] 2023-09-22 17:02:17,406 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, UNASSIGN 2023-09-22 17:02:17,406 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, UNASSIGN 2023-09-22 17:02:17,407 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=70aff4de89d0651e85104baa2e6f078b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:17,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a6f4f877b2377fbdae5ac3044e5256c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:17,407 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402137407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402137407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402137407"}]},"ts":"1695402137407"} 2023-09-22 17:02:17,407 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402137407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402137407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402137407"}]},"ts":"1695402137407"} 2023-09-22 17:02:17,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 70aff4de89d0651e85104baa2e6f078b, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:02:17,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure a6f4f877b2377fbdae5ac3044e5256c1, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:02:17,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 17:02:17,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:17,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 70aff4de89d0651e85104baa2e6f078b, disabling compactions & flushes 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a6f4f877b2377fbdae5ac3044e5256c1, disabling compactions & flushes 2023-09-22 17:02:17,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:17,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. after waiting 0 ms 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. after waiting 0 ms 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:17,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:17,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:02:17,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:02:17,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:17,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:17,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b. 2023-09-22 17:02:17,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1. 2023-09-22 17:02:17,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 70aff4de89d0651e85104baa2e6f078b: 2023-09-22 17:02:17,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a6f4f877b2377fbdae5ac3044e5256c1: 2023-09-22 17:02:17,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:17,600 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=70aff4de89d0651e85104baa2e6f078b, regionState=CLOSED 2023-09-22 17:02:17,600 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402137599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402137599"}]},"ts":"1695402137599"} 2023-09-22 17:02:17,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:17,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a6f4f877b2377fbdae5ac3044e5256c1, regionState=CLOSED 2023-09-22 17:02:17,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695402137601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402137601"}]},"ts":"1695402137601"} 2023-09-22 17:02:17,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-22 17:02:17,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 70aff4de89d0651e85104baa2e6f078b, server=jenkins-hbase4.apache.org,40079,1695402113120 in 194 msec 2023-09-22 17:02:17,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-22 17:02:17,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure a6f4f877b2377fbdae5ac3044e5256c1, server=jenkins-hbase4.apache.org,44379,1695402113177 in 194 msec 2023-09-22 17:02:17,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=70aff4de89d0651e85104baa2e6f078b, UNASSIGN in 203 msec 2023-09-22 17:02:17,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-22 17:02:17,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a6f4f877b2377fbdae5ac3044e5256c1, UNASSIGN in 204 msec 2023-09-22 17:02:17,611 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402137611"}]},"ts":"1695402137611"} 2023-09-22 17:02:17,613 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-22 17:02:17,615 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-22 17:02:17,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 230 msec 2023-09-22 17:02:17,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-22 17:02:17,701 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-22 17:02:17,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-22 17:02:17,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-22 17:02:17,719 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,721 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-22 17:02:17,724 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 17:02:17,724 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 17:02:17,724 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 17:02:17,724 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-22 17:02:17,725 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:17,725 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:17,726 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:17,726 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:17,727 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:17,726 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:17,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 17:02:17,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 17:02:17,727 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 17:02:17,727 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 17:02:17,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 17:02:17,727 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 17:02:17,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-22 17:02:17,727 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-22 17:02:17,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-22 17:02:17,730 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/recovered.edits] 2023-09-22 17:02:17,730 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/recovered.edits] 2023-09-22 17:02:17,738 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf/140879118cfb4b76a8579f2730a4acad to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/cf/140879118cfb4b76a8579f2730a4acad 2023-09-22 17:02:17,738 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf/0c06f39877bb46419d3bfe076e150b4b to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/cf/0c06f39877bb46419d3bfe076e150b4b 2023-09-22 17:02:17,743 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1/recovered.edits/9.seqid 2023-09-22 17:02:17,743 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b/recovered.edits/9.seqid 2023-09-22 17:02:17,744 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/a6f4f877b2377fbdae5ac3044e5256c1 2023-09-22 17:02:17,744 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportWithTargetName/70aff4de89d0651e85104baa2e6f078b 2023-09-22 17:02:17,744 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-22 17:02:17,744 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-22 17:02:17,746 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-22 17:02:17,750 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922520d617731f04851b4d391652c054ea1 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230922520d617731f04851b4d391652c054ea1 2023-09-22 17:02:17,752 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309227e97ccc5f4e74bee97d23fa7d41b8770 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309227e97ccc5f4e74bee97d23fa7d41b8770 2023-09-22 17:02:17,753 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-22 17:02:17,757 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,796 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-22 17:02:17,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-22 17:02:17,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-22 17:02:17,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402137801"}]},"ts":"9223372036854775807"} 2023-09-22 17:02:17,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402137801"}]},"ts":"9223372036854775807"} 2023-09-22 17:02:17,805 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 17:02:17,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 70aff4de89d0651e85104baa2e6f078b, NAME => 'testtb-testExportWithTargetName,,1695402120736.70aff4de89d0651e85104baa2e6f078b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a6f4f877b2377fbdae5ac3044e5256c1, NAME => 'testtb-testExportWithTargetName,1,1695402120736.a6f4f877b2377fbdae5ac3044e5256c1.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 17:02:17,805 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-22 17:02:17,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402137805"}]},"ts":"9223372036854775807"} 2023-09-22 17:02:17,808 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-22 17:02:17,810 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-22 17:02:17,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 103 msec 2023-09-22 17:02:17,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-22 17:02:17,833 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-22 17:02:17,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-22 17:02:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-22 17:02:17,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-22 17:02:17,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-22 17:02:17,890 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 705) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:34895 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:60824 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:50318 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:35840 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-938133480_1 at /127.0.0.1:35810 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:42763 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:46183 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=921 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1290 (was 2065) 2023-09-22 17:02:17,890 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-22 17:02:17,909 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=168, AvailableMemoryMB=1289 2023-09-22 17:02:17,909 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-22 17:02:17,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 17:02:17,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:17,916 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:02:17,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-22 17:02:17,918 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:02:17,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 17:02:17,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:17,921 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:17,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 empty. 2023-09-22 17:02:17,922 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 empty. 2023-09-22 17:02:17,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:17,923 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:17,923 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-22 17:02:17,935 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-22 17:02:17,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 275ad12b150b1ff1d562c7179bda9ce4, NAME => 'testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:02:17,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cb742bc6d4941e1cfbdb207ad3da74c1, NAME => 'testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:02:17,964 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:17,964 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cb742bc6d4941e1cfbdb207ad3da74c1, disabling compactions & flushes 2023-09-22 17:02:17,965 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:17,965 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:17,965 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. after waiting 0 ms 2023-09-22 17:02:17,965 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:17,965 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:17,965 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cb742bc6d4941e1cfbdb207ad3da74c1: 2023-09-22 17:02:17,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:17,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 275ad12b150b1ff1d562c7179bda9ce4, disabling compactions & flushes 2023-09-22 17:02:17,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:17,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:17,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. after waiting 0 ms 2023-09-22 17:02:17,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:17,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:17,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 275ad12b150b1ff1d562c7179bda9ce4: 2023-09-22 17:02:17,970 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:02:17,971 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402137971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402137971"}]},"ts":"1695402137971"} 2023-09-22 17:02:17,971 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402137971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402137971"}]},"ts":"1695402137971"} 2023-09-22 17:02:17,974 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:02:17,975 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:02:17,975 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402137975"}]},"ts":"1695402137975"} 2023-09-22 17:02:17,977 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-22 17:02:17,980 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:02:17,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:02:17,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:02:17,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:02:17,982 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:02:17,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, ASSIGN}] 2023-09-22 17:02:17,985 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, ASSIGN 2023-09-22 17:02:17,985 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, ASSIGN 2023-09-22 17:02:17,986 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40079,1695402113120; forceNewPlan=false, retain=false 2023-09-22 17:02:17,986 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44379,1695402113177; forceNewPlan=false, retain=false 2023-09-22 17:02:18,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 17:02:18,136 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:02:18,139 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cb742bc6d4941e1cfbdb207ad3da74c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=275ad12b150b1ff1d562c7179bda9ce4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,140 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402138139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402138139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402138139"}]},"ts":"1695402138139"} 2023-09-22 17:02:18,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402138139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402138139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402138139"}]},"ts":"1695402138139"} 2023-09-22 17:02:18,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure cb742bc6d4941e1cfbdb207ad3da74c1, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:02:18,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 275ad12b150b1ff1d562c7179bda9ce4, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:02:18,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 17:02:18,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:18,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb742bc6d4941e1cfbdb207ad3da74c1, NAME => 'testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 17:02:18,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. service=AccessControlService 2023-09-22 17:02:18,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:02:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 275ad12b150b1ff1d562c7179bda9ce4, NAME => 'testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 17:02:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. service=AccessControlService 2023-09-22 17:02:18,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:02:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,302 INFO [StoreOpener-cb742bc6d4941e1cfbdb207ad3da74c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,302 INFO [StoreOpener-275ad12b150b1ff1d562c7179bda9ce4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,303 DEBUG [StoreOpener-cb742bc6d4941e1cfbdb207ad3da74c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf 2023-09-22 17:02:18,303 DEBUG [StoreOpener-cb742bc6d4941e1cfbdb207ad3da74c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf 2023-09-22 17:02:18,304 DEBUG [StoreOpener-275ad12b150b1ff1d562c7179bda9ce4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf 2023-09-22 17:02:18,304 DEBUG [StoreOpener-275ad12b150b1ff1d562c7179bda9ce4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf 2023-09-22 17:02:18,304 INFO [StoreOpener-cb742bc6d4941e1cfbdb207ad3da74c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb742bc6d4941e1cfbdb207ad3da74c1 columnFamilyName cf 2023-09-22 17:02:18,304 INFO [StoreOpener-275ad12b150b1ff1d562c7179bda9ce4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 275ad12b150b1ff1d562c7179bda9ce4 columnFamilyName cf 2023-09-22 17:02:18,305 INFO [StoreOpener-cb742bc6d4941e1cfbdb207ad3da74c1-1] regionserver.HStore(310): Store=cb742bc6d4941e1cfbdb207ad3da74c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:02:18,307 INFO [StoreOpener-275ad12b150b1ff1d562c7179bda9ce4-1] regionserver.HStore(310): Store=275ad12b150b1ff1d562c7179bda9ce4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:02:18,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:18,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:02:18,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:02:18,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb742bc6d4941e1cfbdb207ad3da74c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63284656, jitterRate=-0.05698513984680176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:02:18,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 275ad12b150b1ff1d562c7179bda9ce4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74133903, jitterRate=0.10468123853206635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:02:18,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb742bc6d4941e1cfbdb207ad3da74c1: 2023-09-22 17:02:18,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 275ad12b150b1ff1d562c7179bda9ce4: 2023-09-22 17:02:18,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4., pid=31, masterSystemTime=1695402138297 2023-09-22 17:02:18,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1., pid=30, masterSystemTime=1695402138295 2023-09-22 17:02:18,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,320 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=275ad12b150b1ff1d562c7179bda9ce4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:18,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:18,320 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402138320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402138320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402138320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402138320"}]},"ts":"1695402138320"} 2023-09-22 17:02:18,320 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cb742bc6d4941e1cfbdb207ad3da74c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,321 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402138320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402138320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402138320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402138320"}]},"ts":"1695402138320"} 2023-09-22 17:02:18,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-22 17:02:18,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 275ad12b150b1ff1d562c7179bda9ce4, server=jenkins-hbase4.apache.org,44379,1695402113177 in 179 msec 2023-09-22 17:02:18,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-22 17:02:18,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure cb742bc6d4941e1cfbdb207ad3da74c1, server=jenkins-hbase4.apache.org,40079,1695402113120 in 181 msec 2023-09-22 17:02:18,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, ASSIGN in 344 msec 2023-09-22 17:02:18,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-22 17:02:18,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, ASSIGN in 346 msec 2023-09-22 17:02:18,332 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:02:18,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402138332"}]},"ts":"1695402138332"} 2023-09-22 17:02:18,333 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-22 17:02:18,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:02:18,338 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-22 17:02:18,340 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 17:02:18,342 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:18,342 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:18,342 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:18,342 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:18,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:18,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 432 msec 2023-09-22 17:02:18,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-22 17:02:18,523 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-22 17:02:18,526 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-22 17:02:18,526 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,529 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:18,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:02:18,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402138545 (current time:1695402138545). 2023-09-22 17:02:18,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:02:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x7a489ecb to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@378d28ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:18,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:18,560 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:18,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a489ecb to 127.0.0.1:51340 2023-09-22 17:02:18,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:18,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x1c0eba75 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:18,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@228ed1f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:18,575 DEBUG [hconnection-0x7c1a5f17-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:18,576 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:18,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c0eba75 to 127.0.0.1:51340 2023-09-22 17:02:18,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:18,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 17:02:18,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:02:18,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:02:18,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:02:18,587 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:02:18,588 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695402738588 2023-09-22 17:02:18,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:02:18,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-22 17:02:18,589 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:02:18,589 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:02:18,591 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:02:18,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 17:02:18,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-22 17:02:18,593 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 17:02:18,594 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695402738594 2023-09-22 17:02:18,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,611 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-22 17:02:18,611 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,613 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-22 17:02:18,613 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-22 17:02:18,613 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,613 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,615 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,615 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,615 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,615 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,616 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,616 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,616 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,616 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:02:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 17:02:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 17:02:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 17:02:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,624 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 17:02:18,624 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-22 17:02:18,624 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-22 17:02:18,631 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,631 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,631 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,631 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:18,633 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,633 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:18,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-22 17:02:18,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84a0d6d[Count = 1] remaining members to acquire global barrier 2023-09-22 17:02:18,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:18,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-22 17:02:18,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84a0d6d[Count = 0] remaining members to acquire global barrier 2023-09-22 17:02:18,637 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 17:02:18,637 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:02:18,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,639 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:02:18,639 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:02:18,639 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:18,639 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. started... 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:18,639 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:18,639 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:18,639 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 275ad12b150b1ff1d562c7179bda9ce4: 2023-09-22 17:02:18,639 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. started... 2023-09-22 17:02:18,640 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,641 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb742bc6d4941e1cfbdb207ad3da74c1: 2023-09-22 17:02:18,641 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 17:02:18,641 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:18,642 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,642 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:02:18,642 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:18,642 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:18,642 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 17:02:18,643 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:02:18,673 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. completed. 2023-09-22 17:02:18,674 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 17:02:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:02:18,675 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. completed. 2023-09-22 17:02:18,675 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-22 17:02:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:02:18,677 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 17:02:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:18,678 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 17:02:18,679 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,680 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 17:02:18,680 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:18,680 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-22 17:02:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:02:18,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 17:02:18,689 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-22 17:02:18,689 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:02:18,689 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:02:18,689 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,689 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:02:18,689 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:18,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:02:18,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:18,691 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:02:18,691 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,691 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:18,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:18,691 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,692 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,692 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:18,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:18,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:18,693 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,694 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,696 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:18,696 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,697 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:18,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:18,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,700 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:18,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-22 17:02:18,700 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:18,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:02:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,702 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:18,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:18,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:18,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:18,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 17:02:18,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-22 17:02:18,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,738 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:18,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695402138588Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695402138712 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695402138712Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695402138712Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695402138716 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695402138729 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695402138737 (+8 ms) 2023-09-22 17:02:18,741 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 17:02:18,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 152 msec 2023-09-22 17:02:18,891 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:18,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:02:18,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:02:18,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:02:18,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40079] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:02:18,907 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-22 17:02:18,907 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:18,908 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:18,912 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-22 17:02:18,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:02:18,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402138921 (current time:1695402138921). 2023-09-22 17:02:18,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:02:18,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x55cb18d9 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:18,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@259a2b00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:18,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:18,935 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:18,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55cb18d9 to 127.0.0.1:51340 2023-09-22 17:02:18,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:18,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x59dbcc25 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:18,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@206de9b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:18,944 DEBUG [hconnection-0x56955b65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:18,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:18,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59dbcc25 to 127.0.0.1:51340 2023-09-22 17:02:18,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:18,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 17:02:18,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:02:18,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:02:18,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:02:18,958 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:02:18,959 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695402738959 2023-09-22 17:02:18,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-22 17:02:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:02:18,960 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:02:18,961 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:02:18,962 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:02:18,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 17:02:18,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-22 17:02:18,964 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 17:02:18,965 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695402738965 2023-09-22 17:02:18,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-22 17:02:18,982 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-22 17:02:18,983 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,984 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-22 17:02:18,984 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-22 17:02:18,984 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,984 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,987 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,987 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,987 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,987 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,987 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,987 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 17:02:18,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-22 17:02:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 17:02:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 17:02:18,991 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 17:02:18,991 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,991 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 17:02:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-22 17:02:18,992 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 17:02:18,992 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 17:02:18,992 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 17:02:18,992 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:18,992 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 17:02:18,993 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-22 17:02:18,993 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-22 17:02:18,993 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-22 17:02:18,994 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,994 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,994 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,995 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,995 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,995 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,995 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:18,995 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:18,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,995 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,996 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:18,996 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:18,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:18,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13dafa2e[Count = 1] remaining members to acquire global barrier 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:18,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:18,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:18,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:18,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:19,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-22 17:02:19,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13dafa2e[Count = 0] remaining members to acquire global barrier 2023-09-22 17:02:19,000 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 17:02:19,000 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,001 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:02:19,001 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:02:19,001 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 17:02:19,001 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:02:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:02:19,002 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,002 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:02:19,002 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:19,002 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. started... 2023-09-22 17:02:19,002 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:19,002 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. started... 2023-09-22 17:02:19,002 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 275ad12b150b1ff1d562c7179bda9ce4 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-22 17:02:19,003 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cb742bc6d4941e1cfbdb207ad3da74c1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-22 17:02:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 17:02:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 17:02:19,040 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922ad687d7916da40ba83e938b74e4b6bb3 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922ad687d7916da40ba83e938b74e4b6bb3 2023-09-22 17:02:19,042 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922456ff2f4503f452b98ba56fc25027547 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922456ff2f4503f452b98ba56fc25027547 2023-09-22 17:02:19,061 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:19,061 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/.tmp/cf/416bc26ca87849848d0855d8051f3b9d 2023-09-22 17:02:19,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:02:19,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:19,063 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:02:19,068 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/.tmp/cf/416bc26ca87849848d0855d8051f3b9d as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf/416bc26ca87849848d0855d8051f3b9d 2023-09-22 17:02:19,075 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf/416bc26ca87849848d0855d8051f3b9d, entries=47, sequenceid=6, filesize=12.8 K 2023-09-22 17:02:19,076 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for cb742bc6d4941e1cfbdb207ad3da74c1 in 73ms, sequenceid=6, compaction requested=false 2023-09-22 17:02:19,077 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb742bc6d4941e1cfbdb207ad3da74c1: 2023-09-22 17:02:19,078 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 17:02:19,078 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:19,078 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf/416bc26ca87849848d0855d8051f3b9d] hfiles 2023-09-22 17:02:19,078 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf/416bc26ca87849848d0855d8051f3b9d for snapshot=snaptb0-testExportFileSystemState 2023-09-22 17:02:19,086 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. completed. 2023-09-22 17:02:19,086 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:19,086 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 17:02:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:02:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 17:02:19,091 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 17:02:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:02:19,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 17:02:19,263 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:19,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:02:19,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:19,264 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-22 17:02:19,462 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/.tmp/cf/825236d6bed74a4c8aa333d6538fc2da 2023-09-22 17:02:19,469 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/.tmp/cf/825236d6bed74a4c8aa333d6538fc2da as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf/825236d6bed74a4c8aa333d6538fc2da 2023-09-22 17:02:19,475 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf/825236d6bed74a4c8aa333d6538fc2da, entries=3, sequenceid=6, filesize=5.4 K 2023-09-22 17:02:19,476 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 275ad12b150b1ff1d562c7179bda9ce4 in 474ms, sequenceid=6, compaction requested=false 2023-09-22 17:02:19,476 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 275ad12b150b1ff1d562c7179bda9ce4: 2023-09-22 17:02:19,476 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 17:02:19,476 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:19,476 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf/825236d6bed74a4c8aa333d6538fc2da] hfiles 2023-09-22 17:02:19,476 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf/825236d6bed74a4c8aa333d6538fc2da for snapshot=snaptb0-testExportFileSystemState 2023-09-22 17:02:19,490 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. completed. 2023-09-22 17:02:19,490 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:19,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:19,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:19,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-22 17:02:19,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:02:19,492 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,492 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-22 17:02:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,492 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:19,492 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-22 17:02:19,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:19,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:19,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:19,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:02:19,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 17:02:19,497 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-22 17:02:19,498 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:02:19,498 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:02:19,498 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-22 17:02:19,498 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:02:19,500 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,500 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,500 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:19,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,500 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,500 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,500 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,501 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:19,501 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:19,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,502 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,502 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,504 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:19,505 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-22 17:02:19,505 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:19,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-22 17:02:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:19,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:19,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-22 17:02:19,509 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:19,509 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-22 17:02:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:19,508 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:19,508 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:19,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:02:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:19,509 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:19,511 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:19,512 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,512 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922456ff2f4503f452b98ba56fc25027547, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922ad687d7916da40ba83e938b74e4b6bb3] mob files 2023-09-22 17:02:19,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922456ff2f4503f452b98ba56fc25027547 2023-09-22 17:02:19,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922ad687d7916da40ba83e938b74e4b6bb3 2023-09-22 17:02:19,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-22 17:02:19,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-22 17:02:19,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,552 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695402138959Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695402139525 (+566 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695402139525Loading Region manifests for snaptb0-testExportFileSystemState at 1695402139525Writing data manifest for snaptb0-testExportFileSystemState at 1695402139529 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695402139542 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695402139552 (+10 ms) 2023-09-22 17:02:19,555 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-22 17:02:19,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 596 msec 2023-09-22 17:02:19,564 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:19,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:02:19,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:02:19,566 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566 2023-09-22 17:02:19,566 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44043, tgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566, rawTgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:19,596 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:19,596 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1419312997_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,596 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-22 17:02:19,612 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-22 17:02:19,645 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:19,645 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:19,646 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:19,646 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,537 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-3587423641968401946.jar 2023-09-22 17:02:20,537 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,538 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,607 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-6849013351140750097.jar 2023-09-22 17:02:20,608 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,608 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,609 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,609 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,610 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,610 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:20,610 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:02:20,611 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:02:20,611 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:02:20,612 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:02:20,612 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:02:20,613 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:02:20,613 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:02:20,613 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:02:20,614 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:02:20,614 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:02:20,615 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:20,615 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:20,616 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:20,616 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:20,616 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:20,617 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:20,618 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:21,076 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:02:21,079 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-22 17:02:21,081 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-22 17:02:22,074 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:22,074 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:22,079 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0001_000001 (auth:SIMPLE) 2023-09-22 17:02:22,618 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0002_000001 (auth:SIMPLE) 2023-09-22 17:02:23,202 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:02:26,863 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0002_000001 (auth:SIMPLE) 2023-09-22 17:02:29,099 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0002_000001 (auth:SIMPLE) 2023-09-22 17:02:32,413 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0002_000001 (auth:SIMPLE) 2023-09-22 17:02:34,278 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:02:34,279 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:02:34,288 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-22 17:02:34,288 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:02:34,289 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:02:34,289 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 17:02:34,289 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-22 17:02:34,290 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-22 17:02:34,290 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-22 17:02:34,290 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-22 17:02:34,290 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402139566/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-22 17:02:34,298 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-22 17:02:34,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-22 17:02:34,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 17:02:34,304 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402154304"}]},"ts":"1695402154304"} 2023-09-22 17:02:34,306 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-22 17:02:34,308 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-22 17:02:34,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, UNASSIGN}] 2023-09-22 17:02:34,311 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, UNASSIGN 2023-09-22 17:02:34,311 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, UNASSIGN 2023-09-22 17:02:34,312 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=275ad12b150b1ff1d562c7179bda9ce4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:34,312 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402154312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402154312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402154312"}]},"ts":"1695402154312"} 2023-09-22 17:02:34,312 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cb742bc6d4941e1cfbdb207ad3da74c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:34,312 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402154312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402154312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402154312"}]},"ts":"1695402154312"} 2023-09-22 17:02:34,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 275ad12b150b1ff1d562c7179bda9ce4, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:02:34,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure cb742bc6d4941e1cfbdb207ad3da74c1, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:02:34,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 17:02:34,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:34,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:34,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 275ad12b150b1ff1d562c7179bda9ce4, disabling compactions & flushes 2023-09-22 17:02:34,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb742bc6d4941e1cfbdb207ad3da74c1, disabling compactions & flushes 2023-09-22 17:02:34,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:34,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:34,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:34,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:34,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. after waiting 0 ms 2023-09-22 17:02:34,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:34,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. after waiting 0 ms 2023-09-22 17:02:34,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:34,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:02:34,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:02:34,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:34,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:02:34,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1. 2023-09-22 17:02:34,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb742bc6d4941e1cfbdb207ad3da74c1: 2023-09-22 17:02:34,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4. 2023-09-22 17:02:34,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 275ad12b150b1ff1d562c7179bda9ce4: 2023-09-22 17:02:34,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:34,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cb742bc6d4941e1cfbdb207ad3da74c1, regionState=CLOSED 2023-09-22 17:02:34,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402154480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402154480"}]},"ts":"1695402154480"} 2023-09-22 17:02:34,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:34,480 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=275ad12b150b1ff1d562c7179bda9ce4, regionState=CLOSED 2023-09-22 17:02:34,481 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695402154480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402154480"}]},"ts":"1695402154480"} 2023-09-22 17:02:34,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-22 17:02:34,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure cb742bc6d4941e1cfbdb207ad3da74c1, server=jenkins-hbase4.apache.org,40079,1695402113120 in 166 msec 2023-09-22 17:02:34,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-22 17:02:34,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 275ad12b150b1ff1d562c7179bda9ce4, server=jenkins-hbase4.apache.org,44379,1695402113177 in 168 msec 2023-09-22 17:02:34,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb742bc6d4941e1cfbdb207ad3da74c1, UNASSIGN in 175 msec 2023-09-22 17:02:34,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-22 17:02:34,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=275ad12b150b1ff1d562c7179bda9ce4, UNASSIGN in 175 msec 2023-09-22 17:02:34,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402154487"}]},"ts":"1695402154487"} 2023-09-22 17:02:34,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-22 17:02:34,490 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-22 17:02:34,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-09-22 17:02:34,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-22 17:02:34,606 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-22 17:02:34,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-22 17:02:34,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,612 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-22 17:02:34,613 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,615 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-22 17:02:34,618 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:34,618 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:34,618 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,618 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,618 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,618 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 17:02:34,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 17:02:34,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 17:02:34,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-22 17:02:34,620 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,620 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,620 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:34,620 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,620 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:34,620 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:34,621 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/recovered.edits] 2023-09-22 17:02:34,621 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/recovered.edits] 2023-09-22 17:02:34,621 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-22 17:02:34,621 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:34,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-22 17:02:34,626 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf/825236d6bed74a4c8aa333d6538fc2da to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/cf/825236d6bed74a4c8aa333d6538fc2da 2023-09-22 17:02:34,626 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf/416bc26ca87849848d0855d8051f3b9d to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/cf/416bc26ca87849848d0855d8051f3b9d 2023-09-22 17:02:34,630 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4/recovered.edits/9.seqid 2023-09-22 17:02:34,630 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1/recovered.edits/9.seqid 2023-09-22 17:02:34,630 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/275ad12b150b1ff1d562c7179bda9ce4 2023-09-22 17:02:34,630 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemState/cb742bc6d4941e1cfbdb207ad3da74c1 2023-09-22 17:02:34,630 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-22 17:02:34,631 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-22 17:02:34,632 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-22 17:02:34,635 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922456ff2f4503f452b98ba56fc25027547 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230922456ff2f4503f452b98ba56fc25027547 2023-09-22 17:02:34,637 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922ad687d7916da40ba83e938b74e4b6bb3 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230922ad687d7916da40ba83e938b74e4b6bb3 2023-09-22 17:02:34,638 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-22 17:02:34,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,643 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-22 17:02:34,646 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-22 17:02:34,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-22 17:02:34,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402154647"}]},"ts":"9223372036854775807"} 2023-09-22 17:02:34,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402154647"}]},"ts":"9223372036854775807"} 2023-09-22 17:02:34,650 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 17:02:34,650 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 275ad12b150b1ff1d562c7179bda9ce4, NAME => 'testtb-testExportFileSystemState,,1695402137911.275ad12b150b1ff1d562c7179bda9ce4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cb742bc6d4941e1cfbdb207ad3da74c1, NAME => 'testtb-testExportFileSystemState,1,1695402137911.cb742bc6d4941e1cfbdb207ad3da74c1.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 17:02:34,650 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-22 17:02:34,650 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402154650"}]},"ts":"9223372036854775807"} 2023-09-22 17:02:34,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-22 17:02:34,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-22 17:02:34,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 47 msec 2023-09-22 17:02:34,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-22 17:02:34,723 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-22 17:02:34,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-22 17:02:34,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-22 17:02:34,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-22 17:02:34,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-22 17:02:34,763 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 753) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:38011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:38926 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-752521596_1 at /127.0.0.1:38898 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1961 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:49546 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:39618 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 231) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1119 (was 1289) 2023-09-22 17:02:34,764 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-22 17:02:34,784 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=168, AvailableMemoryMB=1117 2023-09-22 17:02:34,784 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-22 17:02:34,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 17:02:34,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:02:34,791 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:02:34,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-22 17:02:34,792 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:02:34,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 17:02:34,795 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:34,795 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:34,795 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc empty. 2023-09-22 17:02:34,795 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e empty. 2023-09-22 17:02:34,796 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:34,796 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:34,796 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-22 17:02:34,809 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-22 17:02:34,810 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 60dd2a9ab81a37462089ec2c9e9be4fc, NAME => 'testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:02:34,811 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6725fd210b984ddde99ea5585de9474e, NAME => 'testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:02:34,828 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:34,828 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 6725fd210b984ddde99ea5585de9474e, disabling compactions & flushes 2023-09-22 17:02:34,828 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:34,828 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:34,828 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. after waiting 0 ms 2023-09-22 17:02:34,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:34,829 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:34,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 6725fd210b984ddde99ea5585de9474e: 2023-09-22 17:02:34,831 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:34,831 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 60dd2a9ab81a37462089ec2c9e9be4fc, disabling compactions & flushes 2023-09-22 17:02:34,831 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:34,831 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:34,831 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. after waiting 0 ms 2023-09-22 17:02:34,831 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:34,831 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:34,831 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 60dd2a9ab81a37462089ec2c9e9be4fc: 2023-09-22 17:02:34,834 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:02:34,835 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402154835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402154835"}]},"ts":"1695402154835"} 2023-09-22 17:02:34,835 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402154835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402154835"}]},"ts":"1695402154835"} 2023-09-22 17:02:34,838 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:02:34,839 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:02:34,839 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402154839"}]},"ts":"1695402154839"} 2023-09-22 17:02:34,840 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-22 17:02:34,845 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:02:34,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:02:34,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:02:34,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:02:34,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:02:34,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, ASSIGN}] 2023-09-22 17:02:34,850 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, ASSIGN 2023-09-22 17:02:34,850 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, ASSIGN 2023-09-22 17:02:34,851 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1695402113218; forceNewPlan=false, retain=false 2023-09-22 17:02:34,851 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44379,1695402113177; forceNewPlan=false, retain=false 2023-09-22 17:02:34,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 17:02:35,001 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:02:35,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6725fd210b984ddde99ea5585de9474e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,004 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=60dd2a9ab81a37462089ec2c9e9be4fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402155004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402155004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402155004"}]},"ts":"1695402155004"} 2023-09-22 17:02:35,004 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402155004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402155004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402155004"}]},"ts":"1695402155004"} 2023-09-22 17:02:35,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 6725fd210b984ddde99ea5585de9474e, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:02:35,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 60dd2a9ab81a37462089ec2c9e9be4fc, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:02:35,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 17:02:35,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6725fd210b984ddde99ea5585de9474e, NAME => 'testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 17:02:35,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. service=AccessControlService 2023-09-22 17:02:35,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:02:35,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60dd2a9ab81a37462089ec2c9e9be4fc, NAME => 'testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 17:02:35,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:35,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. service=AccessControlService 2023-09-22 17:02:35,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:02:35,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:02:35,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,167 INFO [StoreOpener-6725fd210b984ddde99ea5585de9474e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,168 INFO [StoreOpener-60dd2a9ab81a37462089ec2c9e9be4fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,169 DEBUG [StoreOpener-6725fd210b984ddde99ea5585de9474e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf 2023-09-22 17:02:35,169 DEBUG [StoreOpener-60dd2a9ab81a37462089ec2c9e9be4fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf 2023-09-22 17:02:35,169 DEBUG [StoreOpener-60dd2a9ab81a37462089ec2c9e9be4fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf 2023-09-22 17:02:35,169 DEBUG [StoreOpener-6725fd210b984ddde99ea5585de9474e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf 2023-09-22 17:02:35,170 INFO [StoreOpener-60dd2a9ab81a37462089ec2c9e9be4fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60dd2a9ab81a37462089ec2c9e9be4fc columnFamilyName cf 2023-09-22 17:02:35,170 INFO [StoreOpener-6725fd210b984ddde99ea5585de9474e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6725fd210b984ddde99ea5585de9474e columnFamilyName cf 2023-09-22 17:02:35,171 INFO [StoreOpener-60dd2a9ab81a37462089ec2c9e9be4fc-1] regionserver.HStore(310): Store=60dd2a9ab81a37462089ec2c9e9be4fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:02:35,171 INFO [StoreOpener-6725fd210b984ddde99ea5585de9474e-1] regionserver.HStore(310): Store=6725fd210b984ddde99ea5585de9474e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:02:35,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:02:35,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:02:35,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:02:35,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:02:35,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6725fd210b984ddde99ea5585de9474e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65627144, jitterRate=-0.02207934856414795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:02:35,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6725fd210b984ddde99ea5585de9474e: 2023-09-22 17:02:35,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 60dd2a9ab81a37462089ec2c9e9be4fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70722774, jitterRate=0.05385145545005798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:02:35,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 60dd2a9ab81a37462089ec2c9e9be4fc: 2023-09-22 17:02:35,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc., pid=46, masterSystemTime=1695402155159 2023-09-22 17:02:35,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e., pid=45, masterSystemTime=1695402155158 2023-09-22 17:02:35,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=6725fd210b984ddde99ea5585de9474e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402155182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402155182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402155182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402155182"}]},"ts":"1695402155182"} 2023-09-22 17:02:35,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=60dd2a9ab81a37462089ec2c9e9be4fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402155182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402155182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402155182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402155182"}]},"ts":"1695402155182"} 2023-09-22 17:02:35,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-22 17:02:35,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 6725fd210b984ddde99ea5585de9474e, server=jenkins-hbase4.apache.org,44379,1695402113177 in 178 msec 2023-09-22 17:02:35,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-22 17:02:35,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 60dd2a9ab81a37462089ec2c9e9be4fc, server=jenkins-hbase4.apache.org,44467,1695402113218 in 178 msec 2023-09-22 17:02:35,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, ASSIGN in 340 msec 2023-09-22 17:02:35,190 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-22 17:02:35,190 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, ASSIGN in 340 msec 2023-09-22 17:02:35,190 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:02:35,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402155190"}]},"ts":"1695402155190"} 2023-09-22 17:02:35,192 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-22 17:02:35,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:02:35,195 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-22 17:02:35,196 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 17:02:35,198 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:35,198 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:35,198 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:35,198 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:02:35,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:35,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:35,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:35,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-22 17:02:35,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 413 msec 2023-09-22 17:02:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-22 17:02:35,396 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-22 17:02:35,398 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-22 17:02:35,399 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,401 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:35,408 DEBUG [hconnection-0x4e0a2980-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:35,413 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:35,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 17:02:35,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402155418 (current time:1695402155418). 2023-09-22 17:02:35,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:02:35,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x7d3b9b68 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:35,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@704a4c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:35,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:35,430 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:35,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d3b9b68 to 127.0.0.1:51340 2023-09-22 17:02:35,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:35,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x1c093983 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:35,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d4811b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:35,440 DEBUG [hconnection-0x1fc8806e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:35,442 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:35,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c093983 to 127.0.0.1:51340 2023-09-22 17:02:35,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:35,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 17:02:35,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:02:35,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 17:02:35,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 17:02:35,451 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 17:02:35,452 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695402755452 2023-09-22 17:02:35,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 17:02:35,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-22 17:02:35,453 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:02:35,453 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:02:35,454 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 17:02:35,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 17:02:35,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-22 17:02:35,456 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 17:02:35,457 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695402755457 2023-09-22 17:02:35,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,468 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-22 17:02:35,469 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,470 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-22 17:02:35,470 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-22 17:02:35,471 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,471 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,473 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,473 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,473 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,473 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,474 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,474 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,474 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,474 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 17:02:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 17:02:35,475 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 17:02:35,475 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,477 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 17:02:35,477 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 17:02:35,477 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 17:02:35,477 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,477 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 17:02:35,478 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 17:02:35,478 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,478 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 17:02:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 17:02:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 17:02:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 17:02:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-22 17:02:35,482 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-22 17:02:35,483 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,483 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,484 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:35,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,484 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:35,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a6294d0[Count = 1] remaining members to acquire global barrier 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-22 17:02:35,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a6294d0[Count = 0] remaining members to acquire global barrier 2023-09-22 17:02:35,488 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-22 17:02:35,488 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 17:02:35,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,489 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:02:35,490 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,490 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,490 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:02:35,490 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. started... 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:35,490 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,490 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:35,491 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:35,491 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6725fd210b984ddde99ea5585de9474e: 2023-09-22 17:02:35,490 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. started... 2023-09-22 17:02:35,491 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,491 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60dd2a9ab81a37462089ec2c9e9be4fc: 2023-09-22 17:02:35,492 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:35,492 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:02:35,492 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,492 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:35,492 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:02:35,499 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 17:02:35,499 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,499 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 17:02:35,513 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. completed. 2023-09-22 17:02:35,514 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:02:35,514 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. completed. 2023-09-22 17:02:35,514 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-22 17:02:35,514 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:02:35,516 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 17:02:35,516 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,516 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,516 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 17:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,518 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,518 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 17:02:35,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,518 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,518 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-22 17:02:35,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44467,1695402113218': 2023-09-22 17:02:35,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-22 17:02:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:02:35,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-22 17:02:35,526 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-22 17:02:35,526 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:02:35,526 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:02:35,526 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,526 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:02:35,527 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,527 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,527 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,527 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,527 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,528 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,528 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,529 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,530 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,531 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,532 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,532 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,537 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,537 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,537 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,537 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,538 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-22 17:02:35,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:02:35,538 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,537 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,537 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,539 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,538 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 17:02:35,538 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,539 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,540 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,540 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,540 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,541 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,541 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,541 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,554 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:35,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 17:02:35,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:35,555 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:02:35,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-22 17:02:35,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,568 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-22 17:02:35,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695402155452Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695402155548 (+96 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695402155549 (+1 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695402155549Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695402155553 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695402155561 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695402155568 (+7 ms) 2023-09-22 17:02:35,573 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 17:02:35,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 120 msec 2023-09-22 17:02:35,755 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:35,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 17:02:35,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:02:35,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44467] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:02:35,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:02:35,765 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-22 17:02:35,765 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,765 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:02:35,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 17:02:35,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402155777 (current time:1695402155777). 2023-09-22 17:02:35,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:02:35,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x6885c9e5 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:35,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ff204df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:35,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:35,794 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:35,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6885c9e5 to 127.0.0.1:51340 2023-09-22 17:02:35,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:35,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x5562267a to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:02:35,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13ee17d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:02:35,805 DEBUG [hconnection-0xc252d8c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:02:35,806 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:02:35,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5562267a to 127.0.0.1:51340 2023-09-22 17:02:35,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:02:35,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-22 17:02:35,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:02:35,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 17:02:35,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 17:02:35,816 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 17:02:35,816 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695402755816 2023-09-22 17:02:35,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-22 17:02:35,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-22 17:02:35,818 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:02:35,818 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:02:35,819 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-22 17:02:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 17:02:35,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-22 17:02:35,821 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 17:02:35,822 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695402755822 2023-09-22 17:02:35,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-22 17:02:35,835 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-22 17:02:35,835 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,837 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-22 17:02:35,837 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-22 17:02:35,837 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,837 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,839 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,839 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,839 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,839 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,839 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,839 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,840 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,840 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 17:02:35,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 17:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 17:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 17:02:35,841 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 17:02:35,841 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 17:02:35,841 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,841 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 17:02:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 17:02:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 17:02:35,843 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 17:02:35,843 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 17:02:35,843 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 17:02:35,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-22 17:02:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,844 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-22 17:02:35,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-22 17:02:35,844 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-22 17:02:35,844 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:02:35,845 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-22 17:02:35,845 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-22 17:02:35,845 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-22 17:02:35,845 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,845 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,846 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,847 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,847 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,847 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:35,848 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,849 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,849 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:02:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-22 17:02:35,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb5ae37[Count = 1] remaining members to acquire global barrier 2023-09-22 17:02:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-22 17:02:35,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb5ae37[Count = 0] remaining members to acquire global barrier 2023-09-22 17:02:35,853 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-22 17:02:35,853 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,854 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,854 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,854 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,855 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,855 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 17:02:35,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,855 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 17:02:35,855 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 17:02:35,855 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:02:35,855 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-22 17:02:35,855 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,855 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:02:35,856 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:35,856 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:35,856 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,856 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. started... 2023-09-22 17:02:35,856 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6725fd210b984ddde99ea5585de9474e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-22 17:02:35,857 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 17:02:35,857 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,857 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 17:02:35,857 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:02:35,858 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:02:35,858 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,858 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. started... 2023-09-22 17:02:35,859 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 60dd2a9ab81a37462089ec2c9e9be4fc 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-22 17:02:35,886 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922002388fff94643569377719ba65f4ba6 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922002388fff94643569377719ba65f4ba6 2023-09-22 17:02:35,909 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309222d01ac4e12004042be6eebc81e1f21be to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309222d01ac4e12004042be6eebc81e1f21be 2023-09-22 17:02:35,911 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/.tmp/cf/e9d0500ac67d45c3bef0d1ebaef809fb 2023-09-22 17:02:35,917 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/.tmp/cf/e9d0500ac67d45c3bef0d1ebaef809fb as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf/e9d0500ac67d45c3bef0d1ebaef809fb 2023-09-22 17:02:35,918 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:35,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 17:02:35,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:02:35,920 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:02:35,921 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/.tmp/cf/3f586f49bc254525a6b05e7d6d1affd0 2023-09-22 17:02:35,923 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf/e9d0500ac67d45c3bef0d1ebaef809fb, entries=47, sequenceid=6, filesize=12.7 K 2023-09-22 17:02:35,924 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 6725fd210b984ddde99ea5585de9474e in 68ms, sequenceid=6, compaction requested=false 2023-09-22 17:02:35,925 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-22 17:02:35,925 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6725fd210b984ddde99ea5585de9474e: 2023-09-22 17:02:35,925 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 17:02:35,926 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:35,926 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf/e9d0500ac67d45c3bef0d1ebaef809fb] hfiles 2023-09-22 17:02:35,926 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf/e9d0500ac67d45c3bef0d1ebaef809fb for snapshot=snaptb0-testConsecutiveExports 2023-09-22 17:02:35,926 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/.tmp/cf/3f586f49bc254525a6b05e7d6d1affd0 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf/3f586f49bc254525a6b05e7d6d1affd0 2023-09-22 17:02:35,932 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf/3f586f49bc254525a6b05e7d6d1affd0, entries=3, sequenceid=6, filesize=5.4 K 2023-09-22 17:02:35,933 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 60dd2a9ab81a37462089ec2c9e9be4fc in 74ms, sequenceid=6, compaction requested=false 2023-09-22 17:02:35,935 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60dd2a9ab81a37462089ec2c9e9be4fc: 2023-09-22 17:02:35,935 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 17:02:35,935 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:02:35,935 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf/3f586f49bc254525a6b05e7d6d1affd0] hfiles 2023-09-22 17:02:35,935 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf/3f586f49bc254525a6b05e7d6d1affd0 for snapshot=snaptb0-testConsecutiveExports 2023-09-22 17:02:35,940 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. completed. 2023-09-22 17:02:35,940 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:02:35,940 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:35,940 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:35,940 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,940 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 17:02:35,940 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:02:35,942 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 17:02:35,942 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,942 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,942 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 17:02:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:02:35,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-22 17:02:35,953 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. completed. 2023-09-22 17:02:35,953 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:02:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:02:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:02:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-22 17:02:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:02:35,956 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,956 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-22 17:02:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,956 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,956 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-22 17:02:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44467,1695402113218': 2023-09-22 17:02:35,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-22 17:02:35,960 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-22 17:02:35,961 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:02:35,961 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:02:35,961 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-22 17:02:35,961 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:02:35,962 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,962 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,962 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:02:35,962 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,962 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,963 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,964 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,964 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:02:35,964 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:02:35,966 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-22 17:02:35,967 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,967 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:02:35,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-22 17:02:35,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:02:35,976 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:02:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,977 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:02:35,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:02:35,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-22 17:02:35,976 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:02:35,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-22 17:02:35,977 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,979 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:02:35,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:02:35,979 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:02:35,979 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,979 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-22 17:02:35,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:02:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:02:35,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922002388fff94643569377719ba65f4ba6, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309222d01ac4e12004042be6eebc81e1f21be] mob files 2023-09-22 17:02:35,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922002388fff94643569377719ba65f4ba6 2023-09-22 17:02:35,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309222d01ac4e12004042be6eebc81e1f21be 2023-09-22 17:02:35,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-22 17:02:35,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:36,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 17:02:36,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-22 17:02:36,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:36,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:36,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695402155817Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695402155989 (+172 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695402155989Loading Region manifests for snaptb0-testConsecutiveExports at 1695402155989Writing data manifest for snaptb0-testConsecutiveExports at 1695402155994 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695402156002 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695402156010 (+8 ms) 2023-09-22 17:02:36,013 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-22 17:02:36,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 196 msec 2023-09-22 17:02:36,120 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:02:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-22 17:02:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:02:36,122 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122 2023-09-22 17:02:36,122 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:36,144 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:36,144 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@275a6da9, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:36,144 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-22 17:02:36,152 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:36,164 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:36,165 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:36,165 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:36,165 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,044 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-6991174235066248002.jar 2023-09-22 17:02:37,045 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,045 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,112 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-5270253332323547890.jar 2023-09-22 17:02:37,112 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,112 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,113 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,113 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,114 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,114 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:37,114 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:02:37,115 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:02:37,115 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:02:37,115 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:02:37,116 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:02:37,116 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:02:37,117 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:02:37,117 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:02:37,117 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:02:37,118 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:02:37,118 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:37,119 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:37,119 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:37,120 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:37,120 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:37,120 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:37,121 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:37,492 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:02:37,495 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-22 17:02:37,497 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-22 17:02:38,593 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:38,593 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:38,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0002_000001 (auth:SIMPLE) 2023-09-22 17:02:39,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0003_000001 (auth:SIMPLE) 2023-09-22 17:02:40,060 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:02:43,087 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0003_000001 (auth:SIMPLE) 2023-09-22 17:02:45,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0003_000001 (auth:SIMPLE) 2023-09-22 17:02:47,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0003_000001 (auth:SIMPLE) 2023-09-22 17:02:48,652 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:02:48,652 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:02:48,657 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-22 17:02:48,657 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:02:48,657 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:02:48,658 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 17:02:48,660 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 17:02:48,660 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 17:02:48,660 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c6f4238 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 17:02:48,661 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 17:02:48,661 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 17:02:48,662 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:48,684 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:02:48,684 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a640578, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:48,684 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-22 17:02:48,697 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-22 17:02:48,708 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:48,709 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:48,709 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:48,709 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,588 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-4622871910466665355.jar 2023-09-22 17:02:49,589 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,589 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,655 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-6585544070195273561.jar 2023-09-22 17:02:49,656 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,656 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,657 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,657 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,658 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,658 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:02:49,658 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:02:49,659 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:02:49,659 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:02:49,659 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:02:49,660 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:02:49,660 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:02:49,661 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:02:49,661 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:02:49,661 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:02:49,662 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:02:49,662 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:49,664 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:02:49,664 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:49,665 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:02:50,058 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:02:50,060 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-22 17:02:50,062 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-22 17:02:53,761 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:53,761 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:02:53,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0003_000001 (auth:SIMPLE) 2023-09-22 17:02:54,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0004_000001 (auth:SIMPLE) 2023-09-22 17:02:58,235 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0004_000001 (auth:SIMPLE) 2023-09-22 17:03:00,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0004_000001 (auth:SIMPLE) 2023-09-22 17:03:02,679 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0004_000001 (auth:SIMPLE) 2023-09-22 17:03:04,227 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:03:04,227 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:03:04,230 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-22 17:03:04,230 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:03:04,231 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:03:04,231 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 17:03:04,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 17:03:04,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 17:03:04,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c6f4238 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-22 17:03:04,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-22 17:03:04,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/local-export-1695402156122/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-22 17:03:04,248 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-22 17:03:04,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-22 17:03:04,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 17:03:04,252 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402184252"}]},"ts":"1695402184252"} 2023-09-22 17:03:04,253 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-22 17:03:04,255 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-22 17:03:04,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, UNASSIGN}] 2023-09-22 17:03:04,257 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, UNASSIGN 2023-09-22 17:03:04,258 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, UNASSIGN 2023-09-22 17:03:04,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6725fd210b984ddde99ea5585de9474e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:04,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=60dd2a9ab81a37462089ec2c9e9be4fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:04,259 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402184258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402184258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402184258"}]},"ts":"1695402184258"} 2023-09-22 17:03:04,259 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402184258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402184258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402184258"}]},"ts":"1695402184258"} 2023-09-22 17:03:04,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 60dd2a9ab81a37462089ec2c9e9be4fc, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:04,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 6725fd210b984ddde99ea5585de9474e, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:04,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 17:03:04,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:03:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6725fd210b984ddde99ea5585de9474e, disabling compactions & flushes 2023-09-22 17:03:04,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:03:04,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:03:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:03:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. after waiting 0 ms 2023-09-22 17:03:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:03:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 60dd2a9ab81a37462089ec2c9e9be4fc, disabling compactions & flushes 2023-09-22 17:03:04,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:03:04,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:03:04,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. after waiting 0 ms 2023-09-22 17:03:04,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:03:04,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:04,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:04,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:04,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:04,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e. 2023-09-22 17:03:04,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc. 2023-09-22 17:03:04,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6725fd210b984ddde99ea5585de9474e: 2023-09-22 17:03:04,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 60dd2a9ab81a37462089ec2c9e9be4fc: 2023-09-22 17:03:04,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6725fd210b984ddde99ea5585de9474e 2023-09-22 17:03:04,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=6725fd210b984ddde99ea5585de9474e, regionState=CLOSED 2023-09-22 17:03:04,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402184426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402184426"}]},"ts":"1695402184426"} 2023-09-22 17:03:04,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:03:04,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=60dd2a9ab81a37462089ec2c9e9be4fc, regionState=CLOSED 2023-09-22 17:03:04,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695402184426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402184426"}]},"ts":"1695402184426"} 2023-09-22 17:03:04,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-22 17:03:04,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 6725fd210b984ddde99ea5585de9474e, server=jenkins-hbase4.apache.org,44379,1695402113177 in 166 msec 2023-09-22 17:03:04,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-22 17:03:04,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 60dd2a9ab81a37462089ec2c9e9be4fc, server=jenkins-hbase4.apache.org,44467,1695402113218 in 168 msec 2023-09-22 17:03:04,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6725fd210b984ddde99ea5585de9474e, UNASSIGN in 173 msec 2023-09-22 17:03:04,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-22 17:03:04,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=60dd2a9ab81a37462089ec2c9e9be4fc, UNASSIGN in 174 msec 2023-09-22 17:03:04,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402184432"}]},"ts":"1695402184432"} 2023-09-22 17:03:04,433 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-22 17:03:04,436 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-22 17:03:04,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 188 msec 2023-09-22 17:03:04,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-22 17:03:04,554 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-22 17:03:04,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-22 17:03:04,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-22 17:03:04,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,561 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-22 17:03:04,563 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,563 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,563 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,563 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 17:03:04,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 17:03:04,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 17:03:04,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-22 17:03:04,564 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:03:04,565 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-22 17:03:04,565 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:04,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-22 17:03:04,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/recovered.edits] 2023-09-22 17:03:04,567 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/recovered.edits] 2023-09-22 17:03:04,571 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf/3f586f49bc254525a6b05e7d6d1affd0 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/cf/3f586f49bc254525a6b05e7d6d1affd0 2023-09-22 17:03:04,571 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf/e9d0500ac67d45c3bef0d1ebaef809fb to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/cf/e9d0500ac67d45c3bef0d1ebaef809fb 2023-09-22 17:03:04,575 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc/recovered.edits/9.seqid 2023-09-22 17:03:04,575 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e/recovered.edits/9.seqid 2023-09-22 17:03:04,575 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/60dd2a9ab81a37462089ec2c9e9be4fc 2023-09-22 17:03:04,575 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testConsecutiveExports/6725fd210b984ddde99ea5585de9474e 2023-09-22 17:03:04,575 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-22 17:03:04,576 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-22 17:03:04,577 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-22 17:03:04,580 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922002388fff94643569377719ba65f4ba6 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230922002388fff94643569377719ba65f4ba6 2023-09-22 17:03:04,581 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309222d01ac4e12004042be6eebc81e1f21be to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309222d01ac4e12004042be6eebc81e1f21be 2023-09-22 17:03:04,581 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-22 17:03:04,584 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,586 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-22 17:03:04,588 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-22 17:03:04,590 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,590 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-22 17:03:04,590 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402184590"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:04,590 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402184590"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:04,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 17:03:04,592 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 60dd2a9ab81a37462089ec2c9e9be4fc, NAME => 'testtb-testConsecutiveExports,,1695402154786.60dd2a9ab81a37462089ec2c9e9be4fc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6725fd210b984ddde99ea5585de9474e, NAME => 'testtb-testConsecutiveExports,1,1695402154786.6725fd210b984ddde99ea5585de9474e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 17:03:04,592 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-22 17:03:04,592 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402184592"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:04,593 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-22 17:03:04,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-22 17:03:04,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-09-22 17:03:04,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-22 17:03:04,667 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-22 17:03:04,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-22 17:03:04,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-22 17:03:04,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-22 17:03:04,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-22 17:03:04,703 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 761), OpenFileDescriptor=899 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 239), ProcessCount=168 (was 168), AvailableMemoryMB=1013 (was 1117) 2023-09-22 17:03:04,703 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-22 17:03:04,721 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=1012 2023-09-22 17:03:04,721 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-22 17:03:04,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 17:03:04,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:04,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:03:04,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-22 17:03:04,727 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:03:04,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 17:03:04,730 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:04,730 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:04,730 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a empty. 2023-09-22 17:03:04,730 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f empty. 2023-09-22 17:03:04,731 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:04,731 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:04,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-22 17:03:04,744 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-22 17:03:04,745 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 75bc09dcd7687177e7abb0818823b33a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:04,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 664274ed1d8cc8b991fcf587bf0b3a4f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:04,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:04,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 664274ed1d8cc8b991fcf587bf0b3a4f, disabling compactions & flushes 2023-09-22 17:03:04,759 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:04,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:04,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. after waiting 0 ms 2023-09-22 17:03:04,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:04,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:04,760 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 664274ed1d8cc8b991fcf587bf0b3a4f: 2023-09-22 17:03:04,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:04,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 75bc09dcd7687177e7abb0818823b33a, disabling compactions & flushes 2023-09-22 17:03:04,763 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:04,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:04,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. after waiting 0 ms 2023-09-22 17:03:04,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:04,763 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:04,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 75bc09dcd7687177e7abb0818823b33a: 2023-09-22 17:03:04,765 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:03:04,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402184766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402184766"}]},"ts":"1695402184766"} 2023-09-22 17:03:04,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402184766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402184766"}]},"ts":"1695402184766"} 2023-09-22 17:03:04,772 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:03:04,773 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:03:04,773 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402184773"}]},"ts":"1695402184773"} 2023-09-22 17:03:04,775 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-22 17:03:04,778 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:03:04,779 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:03:04,779 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:03:04,779 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:03:04,780 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:03:04,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, ASSIGN}] 2023-09-22 17:03:04,782 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, ASSIGN 2023-09-22 17:03:04,782 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, ASSIGN 2023-09-22 17:03:04,783 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44379,1695402113177; forceNewPlan=false, retain=false 2023-09-22 17:03:04,783 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1695402113218; forceNewPlan=false, retain=false 2023-09-22 17:03:04,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 17:03:04,933 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:03:04,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=664274ed1d8cc8b991fcf587bf0b3a4f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:04,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=75bc09dcd7687177e7abb0818823b33a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:04,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402184936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402184936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402184936"}]},"ts":"1695402184936"} 2023-09-22 17:03:04,936 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402184935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402184935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402184935"}]},"ts":"1695402184935"} 2023-09-22 17:03:04,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 664274ed1d8cc8b991fcf587bf0b3a4f, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:04,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 75bc09dcd7687177e7abb0818823b33a, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:05,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 17:03:05,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 664274ed1d8cc8b991fcf587bf0b3a4f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 17:03:05,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75bc09dcd7687177e7abb0818823b33a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. service=AccessControlService 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. service=AccessControlService 2023-09-22 17:03:05,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,095 INFO [StoreOpener-664274ed1d8cc8b991fcf587bf0b3a4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,095 INFO [StoreOpener-75bc09dcd7687177e7abb0818823b33a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,097 DEBUG [StoreOpener-664274ed1d8cc8b991fcf587bf0b3a4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf 2023-09-22 17:03:05,097 DEBUG [StoreOpener-664274ed1d8cc8b991fcf587bf0b3a4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf 2023-09-22 17:03:05,097 DEBUG [StoreOpener-75bc09dcd7687177e7abb0818823b33a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf 2023-09-22 17:03:05,097 DEBUG [StoreOpener-75bc09dcd7687177e7abb0818823b33a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf 2023-09-22 17:03:05,098 INFO [StoreOpener-75bc09dcd7687177e7abb0818823b33a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75bc09dcd7687177e7abb0818823b33a columnFamilyName cf 2023-09-22 17:03:05,098 INFO [StoreOpener-664274ed1d8cc8b991fcf587bf0b3a4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 664274ed1d8cc8b991fcf587bf0b3a4f columnFamilyName cf 2023-09-22 17:03:05,100 INFO [StoreOpener-75bc09dcd7687177e7abb0818823b33a-1] regionserver.HStore(310): Store=75bc09dcd7687177e7abb0818823b33a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:05,100 INFO [StoreOpener-664274ed1d8cc8b991fcf587bf0b3a4f-1] regionserver.HStore(310): Store=664274ed1d8cc8b991fcf587bf0b3a4f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:05,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:05,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:05,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:05,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 75bc09dcd7687177e7abb0818823b33a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66078029, jitterRate=-0.015360638499259949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 75bc09dcd7687177e7abb0818823b33a: 2023-09-22 17:03:05,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 664274ed1d8cc8b991fcf587bf0b3a4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67663133, jitterRate=0.008259251713752747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 664274ed1d8cc8b991fcf587bf0b3a4f: 2023-09-22 17:03:05,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a., pid=61, masterSystemTime=1695402185090 2023-09-22 17:03:05,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f., pid=60, masterSystemTime=1695402185089 2023-09-22 17:03:05,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,110 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=75bc09dcd7687177e7abb0818823b33a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402185110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402185110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402185110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402185110"}]},"ts":"1695402185110"} 2023-09-22 17:03:05,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=664274ed1d8cc8b991fcf587bf0b3a4f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402185111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402185111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402185111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402185111"}]},"ts":"1695402185111"} 2023-09-22 17:03:05,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-22 17:03:05,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 75bc09dcd7687177e7abb0818823b33a, server=jenkins-hbase4.apache.org,44467,1695402113218 in 173 msec 2023-09-22 17:03:05,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-22 17:03:05,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 664274ed1d8cc8b991fcf587bf0b3a4f, server=jenkins-hbase4.apache.org,44379,1695402113177 in 175 msec 2023-09-22 17:03:05,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, ASSIGN in 335 msec 2023-09-22 17:03:05,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-22 17:03:05,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, ASSIGN in 335 msec 2023-09-22 17:03:05,118 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:03:05,118 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402185118"}]},"ts":"1695402185118"} 2023-09-22 17:03:05,119 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-22 17:03:05,122 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:03:05,122 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-22 17:03:05,124 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 17:03:05,127 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:05,127 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:05,127 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:05,127 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:05,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:05,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:05,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:05,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:05,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 405 msec 2023-09-22 17:03:05,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-22 17:03:05,331 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-22 17:03:05,333 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,333 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,335 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:03:05,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 17:03:05,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402185346 (current time:1695402185346). 2023-09-22 17:03:05,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:05,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x0f792197 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:05,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31bb05d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:05,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:05,358 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:05,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f792197 to 127.0.0.1:51340 2023-09-22 17:03:05,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:05,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x21e1f56d to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:05,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61ac941f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:05,367 DEBUG [hconnection-0x1db32ada-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:05,369 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:05,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21e1f56d to 127.0.0.1:51340 2023-09-22 17:03:05,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:05,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 17:03:05,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:05,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 17:03:05,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 17:03:05,379 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 17:03:05,379 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695402785379 2023-09-22 17:03:05,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 17:03:05,381 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:05,381 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:05,382 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 17:03:05,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 17:03:05,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-22 17:03:05,383 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 17:03:05,384 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695402785384 2023-09-22 17:03:05,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,394 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-22 17:03:05,394 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,395 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-22 17:03:05,395 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-22 17:03:05,396 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,396 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,397 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,397 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,397 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,397 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,397 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,397 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,398 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,398 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 17:03:05,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 17:03:05,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 17:03:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 17:03:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,400 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 17:03:05,401 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 17:03:05,401 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 17:03:05,401 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 17:03:05,402 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 17:03:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,401 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 17:03:05,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,403 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-22 17:03:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 17:03:05,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 17:03:05,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 17:03:05,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 17:03:05,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 17:03:05,405 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,405 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,405 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,405 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,406 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,406 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,406 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,407 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:05,407 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,407 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:05,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53cceb49[Count = 1] remaining members to acquire global barrier 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 17:03:05,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53cceb49[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:05,410 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-22 17:03:05,410 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,411 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,411 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,411 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 17:03:05,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:05,412 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. started... 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 17:03:05,412 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,412 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,412 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 17:03:05,412 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. started... 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:05,412 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75bc09dcd7687177e7abb0818823b33a: 2023-09-22 17:03:05,413 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 664274ed1d8cc8b991fcf587bf0b3a4f: 2023-09-22 17:03:05,412 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 17:03:05,413 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:05,413 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,413 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,414 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:05,414 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:05,414 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:03:05,414 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:03:05,423 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. completed. 2023-09-22 17:03:05,423 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,423 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,424 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. completed. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 17:03:05,424 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 17:03:05,427 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 17:03:05,427 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,427 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,427 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 17:03:05,428 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,428 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 17:03:05,428 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,428 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 17:03:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44467,1695402113218': 2023-09-22 17:03:05,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-22 17:03:05,435 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-22 17:03:05,435 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:05,435 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:05,435 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,435 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,437 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,437 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,438 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,439 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,440 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,440 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,441 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:03:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,444 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,444 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,445 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,446 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,447 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,447 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,447 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,447 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 17:03:05,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-22 17:03:05,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,478 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695402185380Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695402185459 (+79 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695402185459Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695402185459Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695402185464 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695402185472 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695402185478 (+6 ms) 2023-09-22 17:03:05,481 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 17:03:05,482 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:05,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 101 msec 2023-09-22 17:03:05,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 17:03:05,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:05,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44467] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:03:05,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:03:05,488 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,488 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,489 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:03:05,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 17:03:05,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402185498 (current time:1695402185498). 2023-09-22 17:03:05,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:05,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x17a4dce5 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:05,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ce81a00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:05,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:05,507 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:05,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17a4dce5 to 127.0.0.1:51340 2023-09-22 17:03:05,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:05,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x223a3a6c to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:05,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13c8993a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:05,515 DEBUG [hconnection-0x3f5cb959-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:05,518 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:05,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x223a3a6c to 127.0.0.1:51340 2023-09-22 17:03:05,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:05,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-22 17:03:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 17:03:05,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 17:03:05,526 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 17:03:05,527 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695402785527 2023-09-22 17:03:05,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-22 17:03:05,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,528 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:05,528 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:05,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 17:03:05,530 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-22 17:03:05,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-22 17:03:05,532 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 17:03:05,532 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695402785532 2023-09-22 17:03:05,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,542 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-22 17:03:05,542 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,543 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-22 17:03:05,543 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-22 17:03:05,543 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,543 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,545 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,545 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,545 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,545 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,545 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,545 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,545 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,545 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 17:03:05,546 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-22 17:03:05,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,547 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 17:03:05,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,547 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,547 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 17:03:05,548 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 17:03:05,548 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,547 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-22 17:03:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 17:03:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 17:03:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:05,548 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 17:03:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-22 17:03:05,550 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-22 17:03:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 17:03:05,550 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 17:03:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-22 17:03:05,551 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,551 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,551 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,551 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,552 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,552 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,552 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,552 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:05,552 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,553 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,553 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17836094[Count = 1] remaining members to acquire global barrier 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-22 17:03:05,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17836094[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:05,556 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-22 17:03:05,556 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 17:03:05,558 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 17:03:05,559 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,559 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-22 17:03:05,559 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:05,559 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,559 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:05,559 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. started... 2023-09-22 17:03:05,559 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. started... 2023-09-22 17:03:05,559 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 75bc09dcd7687177e7abb0818823b33a 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-22 17:03:05,560 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 664274ed1d8cc8b991fcf587bf0b3a4f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-22 17:03:05,560 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 17:03:05,560 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,560 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 17:03:05,579 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309225244193fb821490494a98be2575ba7d3 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309225244193fb821490494a98be2575ba7d3 2023-09-22 17:03:05,579 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092262735321690f42d49c83bb1a80b4b885 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092262735321690f42d49c83bb1a80b4b885 2023-09-22 17:03:05,586 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/.tmp/cf/d0fe06dfa73c46c183782797093fb2b7 2023-09-22 17:03:05,588 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/.tmp/cf/70a711be51dc4145bd2329f52f144643 2023-09-22 17:03:05,591 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/.tmp/cf/d0fe06dfa73c46c183782797093fb2b7 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf/d0fe06dfa73c46c183782797093fb2b7 2023-09-22 17:03:05,593 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/.tmp/cf/70a711be51dc4145bd2329f52f144643 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf/70a711be51dc4145bd2329f52f144643 2023-09-22 17:03:05,596 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf/d0fe06dfa73c46c183782797093fb2b7, entries=4, sequenceid=6, filesize=5.6 K 2023-09-22 17:03:05,597 INFO [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 75bc09dcd7687177e7abb0818823b33a in 38ms, sequenceid=6, compaction requested=false 2023-09-22 17:03:05,597 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-22 17:03:05,597 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75bc09dcd7687177e7abb0818823b33a: 2023-09-22 17:03:05,598 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,598 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:05,598 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf/d0fe06dfa73c46c183782797093fb2b7] hfiles 2023-09-22 17:03:05,598 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf/d0fe06dfa73c46c183782797093fb2b7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,598 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf/70a711be51dc4145bd2329f52f144643, entries=46, sequenceid=6, filesize=13.4 K 2023-09-22 17:03:05,601 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 664274ed1d8cc8b991fcf587bf0b3a4f in 42ms, sequenceid=6, compaction requested=false 2023-09-22 17:03:05,603 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 664274ed1d8cc8b991fcf587bf0b3a4f: 2023-09-22 17:03:05,603 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,603 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:05,603 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf/70a711be51dc4145bd2329f52f144643] hfiles 2023-09-22 17:03:05,603 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf/70a711be51dc4145bd2329f52f144643 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,607 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. completed. 2023-09-22 17:03:05,607 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:05,607 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:05,607 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:05,607 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,607 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 17:03:05,607 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:05,609 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,609 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 17:03:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,609 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,610 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 17:03:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,612 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. completed. 2023-09-22 17:03:05,612 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:05,613 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:05,613 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,613 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,613 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-22 17:03:05,613 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,614 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,614 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-22 17:03:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-22 17:03:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44467,1695402113218': 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:03:05,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-22 17:03:05,620 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-22 17:03:05,620 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:05,620 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:05,620 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,621 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,627 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,627 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,628 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,628 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:05,628 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 17:03:05,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:03:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,629 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:03:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:05,630 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,630 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,630 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,633 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,633 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,635 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:05,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:03:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,635 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:05,635 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:05,635 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,636 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:05,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,636 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,636 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:05,636 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:05,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:05,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:05,636 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,636 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092262735321690f42d49c83bb1a80b4b885, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309225244193fb821490494a98be2575ba7d3] mob files 2023-09-22 17:03:05,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092262735321690f42d49c83bb1a80b4b885 2023-09-22 17:03:05,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309225244193fb821490494a98be2575ba7d3 2023-09-22 17:03:05,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-22 17:03:05,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,660 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:05,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695402185527Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695402185642 (+115 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695402185643 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695402185643Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695402185646 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695402185652 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695402185659 (+7 ms) 2023-09-22 17:03:05,662 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-22 17:03:05,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 134 msec 2023-09-22 17:03:05,830 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:05,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-22 17:03:05,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:05,859 DEBUG [Listener at jenkins-hbase4.apache.org/44767] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 17:03:05,863 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 17:03:05,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40079] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 17:03:05,865 DEBUG [Listener at jenkins-hbase4.apache.org/44767] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 17:03:05,868 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 17:03:05,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 17:03:05,868 DEBUG [Listener at jenkins-hbase4.apache.org/44767] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-22 17:03:05,872 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-22 17:03:05,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44467] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-22 17:03:05,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-22 17:03:05,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:05,876 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:03:05,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-22 17:03:05,877 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:03:05,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 17:03:05,880 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:05,880 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:05,880 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 empty. 2023-09-22 17:03:05,880 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f empty. 2023-09-22 17:03:05,881 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:05,881 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:05,881 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-22 17:03:05,891 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-22 17:03:05,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 14f3a3a57da7515d6387852f22dfd5d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:05,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => a9e43ac6e07eaa0c2e58e61ff4856e2f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:05,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 14f3a3a57da7515d6387852f22dfd5d4, disabling compactions & flushes 2023-09-22 17:03:05,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. after waiting 0 ms 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing a9e43ac6e07eaa0c2e58e61ff4856e2f, disabling compactions & flushes 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:05,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:05,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 14f3a3a57da7515d6387852f22dfd5d4: 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. after waiting 0 ms 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:05,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:05,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for a9e43ac6e07eaa0c2e58e61ff4856e2f: 2023-09-22 17:03:05,904 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:03:05,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402185905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402185905"}]},"ts":"1695402185905"} 2023-09-22 17:03:05,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402185905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402185905"}]},"ts":"1695402185905"} 2023-09-22 17:03:05,907 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:03:05,908 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:03:05,908 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402185908"}]},"ts":"1695402185908"} 2023-09-22 17:03:05,909 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-22 17:03:05,912 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:03:05,913 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:03:05,913 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:03:05,913 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:03:05,913 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:03:05,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, ASSIGN}] 2023-09-22 17:03:05,916 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, ASSIGN 2023-09-22 17:03:05,916 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, ASSIGN 2023-09-22 17:03:05,916 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44467,1695402113218; forceNewPlan=false, retain=false 2023-09-22 17:03:05,916 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40079,1695402113120; forceNewPlan=false, retain=false 2023-09-22 17:03:05,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 17:03:06,066 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:03:06,069 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a9e43ac6e07eaa0c2e58e61ff4856e2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:06,069 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=14f3a3a57da7515d6387852f22dfd5d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:06,070 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186069"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402186069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402186069"}]},"ts":"1695402186069"} 2023-09-22 17:03:06,070 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186069"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402186069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402186069"}]},"ts":"1695402186069"} 2023-09-22 17:03:06,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 14f3a3a57da7515d6387852f22dfd5d4, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:06,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure a9e43ac6e07eaa0c2e58e61ff4856e2f, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:03:06,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 17:03:06,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14f3a3a57da7515d6387852f22dfd5d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.', STARTKEY => '', ENDKEY => '2'} 2023-09-22 17:03:06,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9e43ac6e07eaa0c2e58e61ff4856e2f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.', STARTKEY => '2', ENDKEY => ''} 2023-09-22 17:03:06,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. service=AccessControlService 2023-09-22 17:03:06,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. service=AccessControlService 2023-09-22 17:03:06,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:06,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,232 INFO [StoreOpener-a9e43ac6e07eaa0c2e58e61ff4856e2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,232 INFO [StoreOpener-14f3a3a57da7515d6387852f22dfd5d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,234 DEBUG [StoreOpener-a9e43ac6e07eaa0c2e58e61ff4856e2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf 2023-09-22 17:03:06,234 DEBUG [StoreOpener-a9e43ac6e07eaa0c2e58e61ff4856e2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf 2023-09-22 17:03:06,234 DEBUG [StoreOpener-14f3a3a57da7515d6387852f22dfd5d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf 2023-09-22 17:03:06,234 DEBUG [StoreOpener-14f3a3a57da7515d6387852f22dfd5d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf 2023-09-22 17:03:06,234 INFO [StoreOpener-a9e43ac6e07eaa0c2e58e61ff4856e2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9e43ac6e07eaa0c2e58e61ff4856e2f columnFamilyName cf 2023-09-22 17:03:06,234 INFO [StoreOpener-14f3a3a57da7515d6387852f22dfd5d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14f3a3a57da7515d6387852f22dfd5d4 columnFamilyName cf 2023-09-22 17:03:06,235 INFO [StoreOpener-a9e43ac6e07eaa0c2e58e61ff4856e2f-1] regionserver.HStore(310): Store=a9e43ac6e07eaa0c2e58e61ff4856e2f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:06,235 INFO [StoreOpener-14f3a3a57da7515d6387852f22dfd5d4-1] regionserver.HStore(310): Store=14f3a3a57da7515d6387852f22dfd5d4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:06,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:06,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 14f3a3a57da7515d6387852f22dfd5d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75095419, jitterRate=0.11900894343852997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:06,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 14f3a3a57da7515d6387852f22dfd5d4: 2023-09-22 17:03:06,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:06,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a9e43ac6e07eaa0c2e58e61ff4856e2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74303575, jitterRate=0.10720954835414886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:06,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a9e43ac6e07eaa0c2e58e61ff4856e2f: 2023-09-22 17:03:06,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4., pid=69, masterSystemTime=1695402186223 2023-09-22 17:03:06,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f., pid=70, masterSystemTime=1695402186224 2023-09-22 17:03:06,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,244 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=14f3a3a57da7515d6387852f22dfd5d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:06,244 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402186244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402186244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402186244"}]},"ts":"1695402186244"} 2023-09-22 17:03:06,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a9e43ac6e07eaa0c2e58e61ff4856e2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:06,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402186244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402186244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402186244"}]},"ts":"1695402186244"} 2023-09-22 17:03:06,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-22 17:03:06,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 14f3a3a57da7515d6387852f22dfd5d4, server=jenkins-hbase4.apache.org,44467,1695402113218 in 174 msec 2023-09-22 17:03:06,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-22 17:03:06,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure a9e43ac6e07eaa0c2e58e61ff4856e2f, server=jenkins-hbase4.apache.org,40079,1695402113120 in 174 msec 2023-09-22 17:03:06,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, ASSIGN in 334 msec 2023-09-22 17:03:06,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-22 17:03:06,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, ASSIGN in 335 msec 2023-09-22 17:03:06,250 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:03:06,250 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402186250"}]},"ts":"1695402186250"} 2023-09-22 17:03:06,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-22 17:03:06,254 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:03:06,255 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-22 17:03:06,256 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-22 17:03:06,257 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:06,257 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:06,257 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:06,257 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:06,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 385 msec 2023-09-22 17:03:06,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-22 17:03:06,482 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-22 17:03:06,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 14f3a3a57da7515d6387852f22dfd5d4, a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14f3a3a57da7515d6387852f22dfd5d4, a9e43ac6e07eaa0c2e58e61ff4856e2f], force=true 2023-09-22 17:03:06,512 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14f3a3a57da7515d6387852f22dfd5d4, a9e43ac6e07eaa0c2e58e61ff4856e2f], force=true 2023-09-22 17:03:06,512 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14f3a3a57da7515d6387852f22dfd5d4, a9e43ac6e07eaa0c2e58e61ff4856e2f], force=true 2023-09-22 17:03:06,512 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14f3a3a57da7515d6387852f22dfd5d4, a9e43ac6e07eaa0c2e58e61ff4856e2f], force=true 2023-09-22 17:03:06,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 17:03:06,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, UNASSIGN}] 2023-09-22 17:03:06,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, UNASSIGN 2023-09-22 17:03:06,534 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, UNASSIGN 2023-09-22 17:03:06,534 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a9e43ac6e07eaa0c2e58e61ff4856e2f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:06,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=14f3a3a57da7515d6387852f22dfd5d4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:06,535 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186534"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402186534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402186534"}]},"ts":"1695402186534"} 2023-09-22 17:03:06,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186534"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402186534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402186534"}]},"ts":"1695402186534"} 2023-09-22 17:03:06,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure a9e43ac6e07eaa0c2e58e61ff4856e2f, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:03:06,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 14f3a3a57da7515d6387852f22dfd5d4, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:06,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 17:03:06,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a9e43ac6e07eaa0c2e58e61ff4856e2f, disabling compactions & flushes 2023-09-22 17:03:06,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. after waiting 0 ms 2023-09-22 17:03:06,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a9e43ac6e07eaa0c2e58e61ff4856e2f 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-22 17:03:06,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 14f3a3a57da7515d6387852f22dfd5d4, disabling compactions & flushes 2023-09-22 17:03:06,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. after waiting 0 ms 2023-09-22 17:03:06,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 14f3a3a57da7515d6387852f22dfd5d4 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-22 17:03:06,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/.tmp/cf/8cc21f12a4c1432c931398b374bf4174 2023-09-22 17:03:06,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/.tmp/cf/389bfe0317174309a49b111610693568 2023-09-22 17:03:06,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/.tmp/cf/389bfe0317174309a49b111610693568 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf/389bfe0317174309a49b111610693568 2023-09-22 17:03:06,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/.tmp/cf/8cc21f12a4c1432c931398b374bf4174 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf/8cc21f12a4c1432c931398b374bf4174 2023-09-22 17:03:06,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf/389bfe0317174309a49b111610693568, entries=1, sequenceid=5, filesize=4.7 K 2023-09-22 17:03:06,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf/8cc21f12a4c1432c931398b374bf4174, entries=1, sequenceid=5, filesize=4.7 K 2023-09-22 17:03:06,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 14f3a3a57da7515d6387852f22dfd5d4 in 22ms, sequenceid=5, compaction requested=false 2023-09-22 17:03:06,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 17:03:06,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a9e43ac6e07eaa0c2e58e61ff4856e2f in 24ms, sequenceid=5, compaction requested=false 2023-09-22 17:03:06,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 17:03:06,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-22 17:03:06,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-22 17:03:06,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:06,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:06,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f. 2023-09-22 17:03:06,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4. 2023-09-22 17:03:06,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a9e43ac6e07eaa0c2e58e61ff4856e2f: 2023-09-22 17:03:06,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 14f3a3a57da7515d6387852f22dfd5d4: 2023-09-22 17:03:06,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:06,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=14f3a3a57da7515d6387852f22dfd5d4, regionState=CLOSED 2023-09-22 17:03:06,731 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402186731"}]},"ts":"1695402186731"} 2023-09-22 17:03:06,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:06,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a9e43ac6e07eaa0c2e58e61ff4856e2f, regionState=CLOSED 2023-09-22 17:03:06,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695402186732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402186732"}]},"ts":"1695402186732"} 2023-09-22 17:03:06,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-22 17:03:06,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 14f3a3a57da7515d6387852f22dfd5d4, server=jenkins-hbase4.apache.org,44467,1695402113218 in 196 msec 2023-09-22 17:03:06,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-22 17:03:06,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure a9e43ac6e07eaa0c2e58e61ff4856e2f, server=jenkins-hbase4.apache.org,40079,1695402113120 in 197 msec 2023-09-22 17:03:06,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=14f3a3a57da7515d6387852f22dfd5d4, UNASSIGN in 205 msec 2023-09-22 17:03:06,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-22 17:03:06,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a9e43ac6e07eaa0c2e58e61ff4856e2f, UNASSIGN in 203 msec 2023-09-22 17:03:06,779 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-22 17:03:06,781 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185874.14f3a3a57da7515d6387852f22dfd5d4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:06,781 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695402185874.a9e43ac6e07eaa0c2e58e61ff4856e2f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:06,781 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:06,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 17:03:06,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, ASSIGN}] 2023-09-22 17:03:06,829 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, ASSIGN 2023-09-22 17:03:06,830 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44467,1695402113218; forceNewPlan=false, retain=false 2023-09-22 17:03:06,980 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-22 17:03:06,982 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=132136f68af672173599b34fe2cce55f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:06,982 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695402186982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402186982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402186982"}]},"ts":"1695402186982"} 2023-09-22 17:03:06,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 132136f68af672173599b34fe2cce55f, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:07,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 17:03:07,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:07,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 132136f68af672173599b34fe2cce55f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.', STARTKEY => '', ENDKEY => ''} 2023-09-22 17:03:07,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. service=AccessControlService 2023-09-22 17:03:07,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:07,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:07,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/.regioninfo 2023-09-22 17:03:07,148 INFO [StoreOpener-132136f68af672173599b34fe2cce55f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,148 DEBUG [StoreOpener-132136f68af672173599b34fe2cce55f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf 2023-09-22 17:03:07,149 DEBUG [StoreOpener-132136f68af672173599b34fe2cce55f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf 2023-09-22 17:03:07,149 INFO [StoreOpener-132136f68af672173599b34fe2cce55f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 132136f68af672173599b34fe2cce55f columnFamilyName cf 2023-09-22 17:03:07,175 DEBUG [StoreOpener-132136f68af672173599b34fe2cce55f-1] regionserver.HStore(539): loaded hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/389bfe0317174309a49b111610693568.14f3a3a57da7515d6387852f22dfd5d4->hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf/389bfe0317174309a49b111610693568-top 2023-09-22 17:03:07,181 DEBUG [StoreOpener-132136f68af672173599b34fe2cce55f-1] regionserver.HStore(539): loaded hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/8cc21f12a4c1432c931398b374bf4174.a9e43ac6e07eaa0c2e58e61ff4856e2f->hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf/8cc21f12a4c1432c931398b374bf4174-top 2023-09-22 17:03:07,181 INFO [StoreOpener-132136f68af672173599b34fe2cce55f-1] regionserver.HStore(310): Store=132136f68af672173599b34fe2cce55f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:07,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:07,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 132136f68af672173599b34fe2cce55f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62531981, jitterRate=-0.06820087134838104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:07,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 132136f68af672173599b34fe2cce55f: 2023-09-22 17:03:07,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f., pid=77, masterSystemTime=1695402187135 2023-09-22 17:03:07,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.,because compaction is disabled. 2023-09-22 17:03:07,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:07,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:07,190 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=132136f68af672173599b34fe2cce55f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,190 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695402187190"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402187190"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402187190"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402187190"}]},"ts":"1695402187190"} 2023-09-22 17:03:07,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-22 17:03:07,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 132136f68af672173599b34fe2cce55f, server=jenkins-hbase4.apache.org,44467,1695402113218 in 208 msec 2023-09-22 17:03:07,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-22 17:03:07,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, ASSIGN in 365 msec 2023-09-22 17:03:07,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[14f3a3a57da7515d6387852f22dfd5d4, a9e43ac6e07eaa0c2e58e61ff4856e2f], force=true in 690 msec 2023-09-22 17:03:07,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-22 17:03:07,619 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-22 17:03:07,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 17:03:07,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402187619 (current time:1695402187619). 2023-09-22 17:03:07,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:07,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x7e0de533 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:07,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ef8cf6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:07,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:07,629 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:07,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e0de533 to 127.0.0.1:51340 2023-09-22 17:03:07,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:07,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x1d96f679 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:07,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ca3ac85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:07,637 DEBUG [hconnection-0x2488b9ed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:07,639 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:07,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d96f679 to 127.0.0.1:51340 2023-09-22 17:03:07,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:07,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-22 17:03:07,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:07,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 17:03:07,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 17:03:07,647 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 17:03:07,647 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695402787647 2023-09-22 17:03:07,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-22 17:03:07,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,650 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:07,651 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:07,652 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-22 17:03:07,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 17:03:07,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-22 17:03:07,654 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 17:03:07,654 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695402787654 2023-09-22 17:03:07,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,664 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-22 17:03:07,665 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:07,665 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-22 17:03:07,666 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-22 17:03:07,666 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,666 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,667 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:07,667 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:07,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:07,667 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,667 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:07,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:07,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:07,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:07,668 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,668 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-22 17:03:07,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,673 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 17:03:07,673 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 17:03:07,673 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:07,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 17:03:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-22 17:03:07,673 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 17:03:07,675 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 17:03:07,676 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 17:03:07,676 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-22 17:03:07,676 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-22 17:03:07,675 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 17:03:07,676 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 17:03:07,676 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-22 17:03:07,678 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,678 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:07,678 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,679 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:07,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-22 17:03:07,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5989b2a0[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:07,681 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-22 17:03:07,681 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,682 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:07,682 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:07,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:07,683 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:07,683 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. started... 2023-09-22 17:03:07,684 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 132136f68af672173599b34fe2cce55f: 2023-09-22 17:03:07,684 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,684 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:07,685 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/389bfe0317174309a49b111610693568.14f3a3a57da7515d6387852f22dfd5d4->hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf/389bfe0317174309a49b111610693568-top, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/8cc21f12a4c1432c931398b374bf4174.a9e43ac6e07eaa0c2e58e61ff4856e2f->hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf/8cc21f12a4c1432c931398b374bf4174-top] hfiles 2023-09-22 17:03:07,685 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/389bfe0317174309a49b111610693568.14f3a3a57da7515d6387852f22dfd5d4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,685 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/8cc21f12a4c1432c931398b374bf4174.a9e43ac6e07eaa0c2e58e61ff4856e2f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,686 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 17:03:07,686 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:07,686 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 17:03:07,688 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 17:03:07,688 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:07,688 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 17:03:07,699 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. completed. 2023-09-22 17:03:07,699 DEBUG [rs(jenkins-hbase4.apache.org,44467,1695402113218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:07,699 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:07,699 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:07,699 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,700 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-22 17:03:07,700 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:07,704 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-22 17:03:07,704 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,704 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,704 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-22 17:03:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:07,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44467,1695402113218': 2023-09-22 17:03:07,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-22 17:03:07,707 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-22 17:03:07,707 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:07,707 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:07,707 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,707 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:07,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,709 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:07,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:07,710 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:07,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,710 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,711 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,712 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:07,713 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,713 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,716 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:07,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,717 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:07,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:07,717 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:07,719 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,719 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:07,719 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:07,719 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,719 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:07,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:07,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-22 17:03:07,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,738 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695402187647Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695402187717 (+70 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695402187717Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695402187722 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695402187729 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695402187737 (+8 ms) 2023-09-22 17:03:07,740 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-22 17:03:07,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 90 msec 2023-09-22 17:03:07,751 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:07,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-22 17:03:07,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:07,752 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752 2023-09-22 17:03:07,752 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44043, tgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752, rawTgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:03:07,774 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:03:07,774 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1943473939_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,774 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-22 17:03:07,782 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:07,801 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:07,801 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:07,802 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:07,802 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,674 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-357329792229949081.jar 2023-09-22 17:03:08,675 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,675 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,741 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-8694218907759586113.jar 2023-09-22 17:03:08,742 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,742 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,743 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,743 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,743 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,744 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:08,744 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:03:08,744 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:03:08,745 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:03:08,745 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:03:08,745 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:03:08,746 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:03:08,746 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:03:08,747 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:03:08,747 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:03:08,747 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:03:08,748 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:08,748 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:08,749 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:08,749 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:08,749 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:08,750 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:08,750 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:08,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0004_000001 (auth:SIMPLE) 2023-09-22 17:03:09,104 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:03:09,107 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-22 17:03:09,109 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-22 17:03:09,166 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:03:09,166 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:03:09,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0005_000001 (auth:SIMPLE) 2023-09-22 17:03:10,002 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:03:13,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0005_000001 (auth:SIMPLE) 2023-09-22 17:03:15,625 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0005_000001 (auth:SIMPLE) 2023-09-22 17:03:17,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0005_000001 (auth:SIMPLE) 2023-09-22 17:03:19,275 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:03:19,278 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:03:19,286 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,286 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:03:19,287 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:03:19,287 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,288 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-22 17:03:19,288 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-22 17:03:19,288 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,288 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-22 17:03:19,288 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402187752/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-22 17:03:19,295 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 17:03:19,299 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402199299"}]},"ts":"1695402199299"} 2023-09-22 17:03:19,301 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-22 17:03:19,302 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-22 17:03:19,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, UNASSIGN}] 2023-09-22 17:03:19,305 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, UNASSIGN 2023-09-22 17:03:19,306 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=132136f68af672173599b34fe2cce55f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:19,306 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695402199306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402199306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402199306"}]},"ts":"1695402199306"} 2023-09-22 17:03:19,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 132136f68af672173599b34fe2cce55f, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:19,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 17:03:19,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:19,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 132136f68af672173599b34fe2cce55f, disabling compactions & flushes 2023-09-22 17:03:19,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:19,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:19,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. after waiting 0 ms 2023-09-22 17:03:19,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:19,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-22 17:03:19,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:19,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f. 2023-09-22 17:03:19,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 132136f68af672173599b34fe2cce55f: 2023-09-22 17:03:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 132136f68af672173599b34fe2cce55f 2023-09-22 17:03:19,473 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=132136f68af672173599b34fe2cce55f, regionState=CLOSED 2023-09-22 17:03:19,473 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695402199473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402199473"}]},"ts":"1695402199473"} 2023-09-22 17:03:19,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-22 17:03:19,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 132136f68af672173599b34fe2cce55f, server=jenkins-hbase4.apache.org,44467,1695402113218 in 168 msec 2023-09-22 17:03:19,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-22 17:03:19,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=132136f68af672173599b34fe2cce55f, UNASSIGN in 173 msec 2023-09-22 17:03:19,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402199478"}]},"ts":"1695402199478"} 2023-09-22 17:03:19,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-22 17:03:19,481 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-22 17:03:19,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-09-22 17:03:19,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-22 17:03:19,602 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-22 17:03:19,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,606 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,606 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,608 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,611 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:19,611 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f 2023-09-22 17:03:19,611 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:19,611 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,611 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,611 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,611 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 17:03:19,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 17:03:19,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 17:03:19,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-22 17:03:19,613 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/recovered.edits] 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:19,613 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/recovered.edits] 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:19,613 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:19,614 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/recovered.edits] 2023-09-22 17:03:19,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:19,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:19,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-22 17:03:19,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:19,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:19,618 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/389bfe0317174309a49b111610693568.14f3a3a57da7515d6387852f22dfd5d4 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/389bfe0317174309a49b111610693568.14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:19,619 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf/389bfe0317174309a49b111610693568 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/cf/389bfe0317174309a49b111610693568 2023-09-22 17:03:19,619 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf/8cc21f12a4c1432c931398b374bf4174 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/cf/8cc21f12a4c1432c931398b374bf4174 2023-09-22 17:03:19,620 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/8cc21f12a4c1432c931398b374bf4174.a9e43ac6e07eaa0c2e58e61ff4856e2f to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/cf/8cc21f12a4c1432c931398b374bf4174.a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:19,622 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/recovered.edits/8.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4/recovered.edits/8.seqid 2023-09-22 17:03:19,622 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/recovered.edits/8.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f/recovered.edits/8.seqid 2023-09-22 17:03:19,622 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/14f3a3a57da7515d6387852f22dfd5d4 2023-09-22 17:03:19,623 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a9e43ac6e07eaa0c2e58e61ff4856e2f 2023-09-22 17:03:19,623 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/recovered.edits/12.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f/recovered.edits/12.seqid 2023-09-22 17:03:19,624 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/132136f68af672173599b34fe2cce55f 2023-09-22 17:03:19,624 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-22 17:03:19,626 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,628 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-22 17:03:19,630 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-22 17:03:19,631 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,631 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-22 17:03:19,631 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402199631"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:19,632 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-22 17:03:19,632 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 132136f68af672173599b34fe2cce55f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695402185875.132136f68af672173599b34fe2cce55f.', STARTKEY => '', ENDKEY => ''}] 2023-09-22 17:03:19,632 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-22 17:03:19,632 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402199632"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:19,634 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-22 17:03:19,635 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:19,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-09-22 17:03:19,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-22 17:03:19,715 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-22 17:03:19,716 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:19,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:19,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:19,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 17:03:19,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402199720"}]},"ts":"1695402199720"} 2023-09-22 17:03:19,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-22 17:03:19,723 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-22 17:03:19,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, UNASSIGN}] 2023-09-22 17:03:19,726 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, UNASSIGN 2023-09-22 17:03:19,726 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, UNASSIGN 2023-09-22 17:03:19,726 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=75bc09dcd7687177e7abb0818823b33a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:19,727 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=664274ed1d8cc8b991fcf587bf0b3a4f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:19,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402199726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402199726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402199726"}]},"ts":"1695402199726"} 2023-09-22 17:03:19,727 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402199727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402199727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402199727"}]},"ts":"1695402199727"} 2023-09-22 17:03:19,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 75bc09dcd7687177e7abb0818823b33a, server=jenkins-hbase4.apache.org,44467,1695402113218}] 2023-09-22 17:03:19,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 664274ed1d8cc8b991fcf587bf0b3a4f, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:19,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 17:03:19,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:19,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 75bc09dcd7687177e7abb0818823b33a, disabling compactions & flushes 2023-09-22 17:03:19,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:19,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:19,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. after waiting 0 ms 2023-09-22 17:03:19,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:19,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:19,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 664274ed1d8cc8b991fcf587bf0b3a4f, disabling compactions & flushes 2023-09-22 17:03:19,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:19,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:19,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. after waiting 0 ms 2023-09-22 17:03:19,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:19,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:19,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:19,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a. 2023-09-22 17:03:19,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:19,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:19,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f. 2023-09-22 17:03:19,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 664274ed1d8cc8b991fcf587bf0b3a4f: 2023-09-22 17:03:19,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:19,896 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=664274ed1d8cc8b991fcf587bf0b3a4f, regionState=CLOSED 2023-09-22 17:03:19,896 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402199896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402199896"}]},"ts":"1695402199896"} 2023-09-22 17:03:19,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 75bc09dcd7687177e7abb0818823b33a: 2023-09-22 17:03:19,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:19,898 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=75bc09dcd7687177e7abb0818823b33a, regionState=CLOSED 2023-09-22 17:03:19,898 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695402199898"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402199898"}]},"ts":"1695402199898"} 2023-09-22 17:03:19,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-22 17:03:19,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 664274ed1d8cc8b991fcf587bf0b3a4f, server=jenkins-hbase4.apache.org,44379,1695402113177 in 169 msec 2023-09-22 17:03:19,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=664274ed1d8cc8b991fcf587bf0b3a4f, UNASSIGN in 175 msec 2023-09-22 17:03:19,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-22 17:03:19,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 75bc09dcd7687177e7abb0818823b33a, server=jenkins-hbase4.apache.org,44467,1695402113218 in 172 msec 2023-09-22 17:03:19,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-22 17:03:19,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75bc09dcd7687177e7abb0818823b33a, UNASSIGN in 177 msec 2023-09-22 17:03:19,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402199903"}]},"ts":"1695402199903"} 2023-09-22 17:03:19,905 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-22 17:03:19,907 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-22 17:03:19,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 191 msec 2023-09-22 17:03:20,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-22 17:03:20,022 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-22 17:03:20,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,026 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,027 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,028 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,030 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,030 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,030 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,030 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 17:03:20,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 17:03:20,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 17:03:20,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-22 17:03:20,031 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:20,031 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,033 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,034 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/recovered.edits] 2023-09-22 17:03:20,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-22 17:03:20,034 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/recovered.edits] 2023-09-22 17:03:20,037 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf/d0fe06dfa73c46c183782797093fb2b7 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/cf/d0fe06dfa73c46c183782797093fb2b7 2023-09-22 17:03:20,038 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf/70a711be51dc4145bd2329f52f144643 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/cf/70a711be51dc4145bd2329f52f144643 2023-09-22 17:03:20,040 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a/recovered.edits/9.seqid 2023-09-22 17:03:20,040 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f/recovered.edits/9.seqid 2023-09-22 17:03:20,041 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75bc09dcd7687177e7abb0818823b33a 2023-09-22 17:03:20,041 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/664274ed1d8cc8b991fcf587bf0b3a4f 2023-09-22 17:03:20,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-22 17:03:20,041 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-22 17:03:20,042 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-22 17:03:20,045 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092262735321690f42d49c83bb1a80b4b885 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092262735321690f42d49c83bb1a80b4b885 2023-09-22 17:03:20,046 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309225244193fb821490494a98be2575ba7d3 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309225244193fb821490494a98be2575ba7d3 2023-09-22 17:03:20,047 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-22 17:03:20,048 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,050 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-22 17:03:20,052 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-22 17:03:20,053 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,053 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-22 17:03:20,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402200053"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:20,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402200053"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:20,054 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 17:03:20,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75bc09dcd7687177e7abb0818823b33a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695402184723.75bc09dcd7687177e7abb0818823b33a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 664274ed1d8cc8b991fcf587bf0b3a4f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695402184723.664274ed1d8cc8b991fcf587bf0b3a4f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 17:03:20,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-22 17:03:20,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402200055"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:20,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-22 17:03:20,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-22 17:03:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-22 17:03:20,135 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-22 17:03:20,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-22 17:03:20,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-22 17:03:20,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-22 17:03:20,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-22 17:03:20,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-22 17:03:20,175 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 749) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:36206 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:33390 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3956 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-643981341_1 at /127.0.0.1:39690 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:39716 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:39717 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 202), ProcessCount=168 (was 168), AvailableMemoryMB=952 (was 1012) 2023-09-22 17:03:20,175 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-22 17:03:20,194 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=168, AvailableMemoryMB=952 2023-09-22 17:03:20,194 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-22 17:03:20,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 17:03:20,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:20,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:03:20,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-22 17:03:20,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:03:20,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 17:03:20,200 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,200 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,201 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 empty. 2023-09-22 17:03:20,201 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 empty. 2023-09-22 17:03:20,201 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,201 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,201 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-22 17:03:20,210 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-22 17:03:20,211 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => ee043155ca80a40107ee5072f0ab82d3, NAME => 'testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:20,211 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 94f08f37cc4aa12127488f693b5f4732, NAME => 'testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:20,218 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:20,218 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing ee043155ca80a40107ee5072f0ab82d3, disabling compactions & flushes 2023-09-22 17:03:20,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. after waiting 0 ms 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for ee043155ca80a40107ee5072f0ab82d3: 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 94f08f37cc4aa12127488f693b5f4732, disabling compactions & flushes 2023-09-22 17:03:20,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. after waiting 0 ms 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 94f08f37cc4aa12127488f693b5f4732: 2023-09-22 17:03:20,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:03:20,222 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402200222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402200222"}]},"ts":"1695402200222"} 2023-09-22 17:03:20,222 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402200222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402200222"}]},"ts":"1695402200222"} 2023-09-22 17:03:20,224 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:03:20,224 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:03:20,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402200224"}]},"ts":"1695402200224"} 2023-09-22 17:03:20,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-22 17:03:20,228 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:03:20,229 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:03:20,229 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:03:20,229 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:03:20,229 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:03:20,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, ASSIGN}] 2023-09-22 17:03:20,232 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, ASSIGN 2023-09-22 17:03:20,232 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, ASSIGN 2023-09-22 17:03:20,232 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40079,1695402113120; forceNewPlan=false, retain=false 2023-09-22 17:03:20,232 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44379,1695402113177; forceNewPlan=false, retain=false 2023-09-22 17:03:20,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 17:03:20,383 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:03:20,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ee043155ca80a40107ee5072f0ab82d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=94f08f37cc4aa12127488f693b5f4732, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402200385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402200385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402200385"}]},"ts":"1695402200385"} 2023-09-22 17:03:20,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402200385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402200385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402200385"}]},"ts":"1695402200385"} 2023-09-22 17:03:20,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure ee043155ca80a40107ee5072f0ab82d3, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:03:20,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 94f08f37cc4aa12127488f693b5f4732, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:20,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 17:03:20,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94f08f37cc4aa12127488f693b5f4732, NAME => 'testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 17:03:20,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee043155ca80a40107ee5072f0ab82d3, NAME => 'testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. service=AccessControlService 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. service=AccessControlService 2023-09-22 17:03:20,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:20,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,546 INFO [StoreOpener-ee043155ca80a40107ee5072f0ab82d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,546 INFO [StoreOpener-94f08f37cc4aa12127488f693b5f4732-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,548 DEBUG [StoreOpener-ee043155ca80a40107ee5072f0ab82d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf 2023-09-22 17:03:20,548 DEBUG [StoreOpener-94f08f37cc4aa12127488f693b5f4732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf 2023-09-22 17:03:20,548 DEBUG [StoreOpener-ee043155ca80a40107ee5072f0ab82d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf 2023-09-22 17:03:20,548 DEBUG [StoreOpener-94f08f37cc4aa12127488f693b5f4732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf 2023-09-22 17:03:20,548 INFO [StoreOpener-94f08f37cc4aa12127488f693b5f4732-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94f08f37cc4aa12127488f693b5f4732 columnFamilyName cf 2023-09-22 17:03:20,548 INFO [StoreOpener-ee043155ca80a40107ee5072f0ab82d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee043155ca80a40107ee5072f0ab82d3 columnFamilyName cf 2023-09-22 17:03:20,549 INFO [StoreOpener-94f08f37cc4aa12127488f693b5f4732-1] regionserver.HStore(310): Store=94f08f37cc4aa12127488f693b5f4732/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:20,550 INFO [StoreOpener-ee043155ca80a40107ee5072f0ab82d3-1] regionserver.HStore(310): Store=ee043155ca80a40107ee5072f0ab82d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:20,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:20,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:20,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:20,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:20,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94f08f37cc4aa12127488f693b5f4732; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60417529, jitterRate=-0.0997086614370346}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:20,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94f08f37cc4aa12127488f693b5f4732: 2023-09-22 17:03:20,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ee043155ca80a40107ee5072f0ab82d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65967525, jitterRate=-0.01700727641582489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:20,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ee043155ca80a40107ee5072f0ab82d3: 2023-09-22 17:03:20,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3., pid=93, masterSystemTime=1695402200539 2023-09-22 17:03:20,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732., pid=94, masterSystemTime=1695402200539 2023-09-22 17:03:20,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ee043155ca80a40107ee5072f0ab82d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402200558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402200558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402200558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402200558"}]},"ts":"1695402200558"} 2023-09-22 17:03:20,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,559 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=94f08f37cc4aa12127488f693b5f4732, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402200559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402200559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402200559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402200559"}]},"ts":"1695402200559"} 2023-09-22 17:03:20,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-22 17:03:20,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure ee043155ca80a40107ee5072f0ab82d3, server=jenkins-hbase4.apache.org,40079,1695402113120 in 173 msec 2023-09-22 17:03:20,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-22 17:03:20,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 94f08f37cc4aa12127488f693b5f4732, server=jenkins-hbase4.apache.org,44379,1695402113177 in 173 msec 2023-09-22 17:03:20,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, ASSIGN in 337 msec 2023-09-22 17:03:20,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-22 17:03:20,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, ASSIGN in 337 msec 2023-09-22 17:03:20,570 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:03:20,570 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402200570"}]},"ts":"1695402200570"} 2023-09-22 17:03:20,571 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-22 17:03:20,574 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:03:20,575 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-22 17:03:20,576 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 17:03:20,577 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,577 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,577 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,577 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:20,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:20,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:20,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:20,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:20,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 384 msec 2023-09-22 17:03:20,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-22 17:03:20,802 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-22 17:03:20,804 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:20,805 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,806 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:03:20,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:03:20,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402200817 (current time:1695402200817). 2023-09-22 17:03:20,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:20,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x3d4b9d6f to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:20,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45721769, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:20,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:20,831 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:20,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d4b9d6f to 127.0.0.1:51340 2023-09-22 17:03:20,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:20,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x684f9223 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:20,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@90ecaa0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:20,839 DEBUG [hconnection-0x5c125db7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:20,840 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:20,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x684f9223 to 127.0.0.1:51340 2023-09-22 17:03:20,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:20,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 17:03:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:03:20,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:03:20,849 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:03:20,849 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695402800849 2023-09-22 17:03:20,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:03:20,851 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:20,851 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:20,852 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:03:20,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 17:03:20,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-22 17:03:20,856 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 17:03:20,856 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695402800856 2023-09-22 17:03:20,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,866 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-22 17:03:20,866 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:20,867 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-22 17:03:20,867 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-22 17:03:20,868 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,868 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,875 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:20,875 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:20,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:20,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:20,875 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:20,875 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,875 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,875 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,875 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,876 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 17:03:20,876 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 17:03:20,876 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:20,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,877 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 17:03:20,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,878 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 17:03:20,878 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 17:03:20,878 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:20,878 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 17:03:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 17:03:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 17:03:20,878 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 17:03:20,880 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 17:03:20,880 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 17:03:20,879 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 17:03:20,880 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 17:03:20,881 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,881 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:20,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:20,882 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,882 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,882 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:20,882 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:20,882 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,882 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,883 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:20,883 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,883 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7feb7bb0[Count = 1] remaining members to acquire global barrier 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:20,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:20,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 17:03:20,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7feb7bb0[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:20,887 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 17:03:20,887 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:03:20,889 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:03:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 17:03:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:20,889 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:20,889 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,889 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,889 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:20,889 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. started... 2023-09-22 17:03:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:03:20,890 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ee043155ca80a40107ee5072f0ab82d3: 2023-09-22 17:03:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:20,890 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:20,890 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,890 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,890 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:20,890 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. started... 2023-09-22 17:03:20,890 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:03:20,891 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94f08f37cc4aa12127488f693b5f4732: 2023-09-22 17:03:20,891 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,891 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:20,891 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 17:03:20,891 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:03:20,891 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:20,891 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 17:03:20,905 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. completed. 2023-09-22 17:03:20,905 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. completed. 2023-09-22 17:03:20,905 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:20,905 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:20,905 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:20,907 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 17:03:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 17:03:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:20,907 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 17:03:20,907 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:20,908 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 17:03:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:03:20,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 17:03:20,916 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-22 17:03:20,916 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:20,916 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:20,916 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,916 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:20,917 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,917 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:20,917 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:20,918 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:20,918 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:20,918 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,919 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:20,920 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,921 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,921 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,924 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:20,924 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:20,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:20,925 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:20,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:20,924 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:20,924 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:20,925 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:20,925 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:20,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:20,925 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:20,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:20,925 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:20,925 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:20,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,925 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,927 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 17:03:20,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,951 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:20,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:03:20,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:03:20,952 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:03:20,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,955 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-22 17:03:20,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,955 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:20,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695402200850Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695402200933 (+83 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695402200933Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695402200934 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695402200941 (+7 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695402200950 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695402200955 (+5 ms) 2023-09-22 17:03:20,959 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 17:03:20,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 108 msec 2023-09-22 17:03:21,152 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:21,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:03:21,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:21,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40079] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:03:21,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:03:21,159 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:21,159 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:21,159 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:03:21,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:03:21,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402201167 (current time:1695402201167). 2023-09-22 17:03:21,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:21,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x0220f8a1 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:21,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c91f2b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:21,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:21,179 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:21,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0220f8a1 to 127.0.0.1:51340 2023-09-22 17:03:21,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:21,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x0ad12e6b to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:21,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fb13a60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:21,188 DEBUG [hconnection-0x4cf6656b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:21,190 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:21,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ad12e6b to 127.0.0.1:51340 2023-09-22 17:03:21,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:21,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-22 17:03:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:03:21,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:03:21,198 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:03:21,199 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695402801199 2023-09-22 17:03:21,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-22 17:03:21,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:21,200 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:21,200 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:21,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 17:03:21,201 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-22 17:03:21,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-22 17:03:21,204 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 17:03:21,204 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695402801204 2023-09-22 17:03:21,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,217 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-22 17:03:21,217 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:21,219 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-22 17:03:21,219 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-22 17:03:21,219 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,219 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,220 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:21,220 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:21,221 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:21,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:21,220 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:21,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:21,221 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,221 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,222 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-22 17:03:21,222 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 17:03:21,222 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:21,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,223 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 17:03:21,223 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:21,224 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 17:03:21,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-22 17:03:21,225 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:21,230 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-22 17:03:21,230 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-22 17:03:21,230 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-22 17:03:21,231 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,231 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,231 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:21,231 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:21,233 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,233 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:21,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:21,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b4941a7[Count = 1] remaining members to acquire global barrier 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:21,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:21,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:21,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:21,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-22 17:03:21,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b4941a7[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:21,237 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-22 17:03:21,237 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:03:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-22 17:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:21,242 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. started... 2023-09-22 17:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. started... 2023-09-22 17:03:21,242 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ee043155ca80a40107ee5072f0ab82d3 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-22 17:03:21,242 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,242 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:21,242 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 94f08f37cc4aa12127488f693b5f4732 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-22 17:03:21,244 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 17:03:21,244 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:21,244 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 17:03:21,270 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230922da7cd292aa2f4ab7984d10b17a79b235 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922da7cd292aa2f4ab7984d10b17a79b235 2023-09-22 17:03:21,272 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922ae5da228b88c49ceb52345f437d126a4 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922ae5da228b88c49ceb52345f437d126a4 2023-09-22 17:03:21,281 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/.tmp/cf/cc63460dfafa426795ec754d4202ddf7 2023-09-22 17:03:21,288 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/.tmp/cf/cc63460dfafa426795ec754d4202ddf7 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf/cc63460dfafa426795ec754d4202ddf7 2023-09-22 17:03:21,291 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/.tmp/cf/263940a9fcbc4d8688187e41f0f80e34 2023-09-22 17:03:21,293 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf/cc63460dfafa426795ec754d4202ddf7, entries=47, sequenceid=6, filesize=13.1 K 2023-09-22 17:03:21,295 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 94f08f37cc4aa12127488f693b5f4732 in 53ms, sequenceid=6, compaction requested=false 2023-09-22 17:03:21,295 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-22 17:03:21,296 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94f08f37cc4aa12127488f693b5f4732: 2023-09-22 17:03:21,296 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,296 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:21,296 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf/cc63460dfafa426795ec754d4202ddf7] hfiles 2023-09-22 17:03:21,296 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf/cc63460dfafa426795ec754d4202ddf7 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,297 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/.tmp/cf/263940a9fcbc4d8688187e41f0f80e34 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf/263940a9fcbc4d8688187e41f0f80e34 2023-09-22 17:03:21,301 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:21,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:03:21,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:03:21,302 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:03:21,302 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf/263940a9fcbc4d8688187e41f0f80e34, entries=3, sequenceid=6, filesize=5.4 K 2023-09-22 17:03:21,303 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ee043155ca80a40107ee5072f0ab82d3 in 61ms, sequenceid=6, compaction requested=false 2023-09-22 17:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ee043155ca80a40107ee5072f0ab82d3: 2023-09-22 17:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf/263940a9fcbc4d8688187e41f0f80e34] hfiles 2023-09-22 17:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf/263940a9fcbc4d8688187e41f0f80e34 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,314 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. completed. 2023-09-22 17:03:21,314 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:21,314 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:21,314 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:21,314 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,315 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 17:03:21,315 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:21,316 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,316 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 17:03:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:21,316 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:21,316 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 17:03:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,321 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. completed. 2023-09-22 17:03:21,321 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-22 17:03:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,324 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:21,324 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-22 17:03:21,324 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:21,324 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-22 17:03:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:03:21,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-22 17:03:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:03:21,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-22 17:03:21,330 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-22 17:03:21,330 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:21,330 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:21,330 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,330 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:21,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:21,332 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,332 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:21,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:21,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:21,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,333 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:21,334 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:21,335 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,335 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,335 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:21,338 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:21,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:21,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:21,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:21,338 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:21,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:21,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:21,340 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:21,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:21,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:03:21,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:21,340 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:21,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:21,340 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,340 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922da7cd292aa2f4ab7984d10b17a79b235, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922ae5da228b88c49ceb52345f437d126a4] mob files 2023-09-22 17:03:21,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922da7cd292aa2f4ab7984d10b17a79b235 2023-09-22 17:03:21,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922ae5da228b88c49ceb52345f437d126a4 2023-09-22 17:03:21,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-22 17:03:21,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,375 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695402201199Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695402201347 (+148 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695402201347Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695402201348 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695402201353 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695402201365 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695402201375 (+10 ms) 2023-09-22 17:03:21,380 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-22 17:03:21,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 180 msec 2023-09-22 17:03:21,502 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:21,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-22 17:03:21,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:21,504 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504 2023-09-22 17:03:21,504 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44043, tgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504, rawTgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:03:21,526 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:03:21,526 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1705165190_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,526 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-22 17:03:21,531 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:21,553 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:21,553 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:21,554 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:21,554 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,455 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-2378501144851524337.jar 2023-09-22 17:03:22,455 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,456 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,522 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-3196902054673305411.jar 2023-09-22 17:03:22,522 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,522 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,523 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,523 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,524 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,524 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:22,524 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:03:22,524 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:03:22,525 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:03:22,525 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:03:22,525 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:03:22,526 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:03:22,526 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:03:22,527 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:03:22,527 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:03:22,527 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:03:22,528 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:22,528 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:22,529 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:22,529 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:22,529 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:22,530 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:22,530 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:22,891 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:03:22,893 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-22 17:03:24,108 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:03:24,108 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:03:24,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0005_000001 (auth:SIMPLE) 2023-09-22 17:03:24,874 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0006_000001 (auth:SIMPLE) 2023-09-22 17:03:25,056 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:03:28,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0006_000001 (auth:SIMPLE) 2023-09-22 17:03:31,229 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:03:31,230 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:03:31,235 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:31,235 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:03:31,235 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:03:31,236 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:31,236 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-22 17:03:31,236 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-22 17:03:31,236 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:31,237 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-22 17:03:31,237 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402201504/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-22 17:03:31,242 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 17:03:31,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402211246"}]},"ts":"1695402211246"} 2023-09-22 17:03:31,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-22 17:03:31,249 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-22 17:03:31,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, UNASSIGN}] 2023-09-22 17:03:31,252 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, UNASSIGN 2023-09-22 17:03:31,252 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, UNASSIGN 2023-09-22 17:03:31,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ee043155ca80a40107ee5072f0ab82d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:31,253 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=94f08f37cc4aa12127488f693b5f4732, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:31,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402211252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402211252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402211252"}]},"ts":"1695402211252"} 2023-09-22 17:03:31,253 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402211253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402211253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402211253"}]},"ts":"1695402211253"} 2023-09-22 17:03:31,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure ee043155ca80a40107ee5072f0ab82d3, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:03:31,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 94f08f37cc4aa12127488f693b5f4732, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:31,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 17:03:31,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:31,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ee043155ca80a40107ee5072f0ab82d3, disabling compactions & flushes 2023-09-22 17:03:31,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:31,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:31,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. after waiting 0 ms 2023-09-22 17:03:31,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:31,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:31,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94f08f37cc4aa12127488f693b5f4732, disabling compactions & flushes 2023-09-22 17:03:31,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:31,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:31,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. after waiting 0 ms 2023-09-22 17:03:31,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:31,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:31,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:31,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3. 2023-09-22 17:03:31,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ee043155ca80a40107ee5072f0ab82d3: 2023-09-22 17:03:31,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:31,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732. 2023-09-22 17:03:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94f08f37cc4aa12127488f693b5f4732: 2023-09-22 17:03:31,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:31,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ee043155ca80a40107ee5072f0ab82d3, regionState=CLOSED 2023-09-22 17:03:31,420 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402211420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402211420"}]},"ts":"1695402211420"} 2023-09-22 17:03:31,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:31,421 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=94f08f37cc4aa12127488f693b5f4732, regionState=CLOSED 2023-09-22 17:03:31,421 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695402211421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402211421"}]},"ts":"1695402211421"} 2023-09-22 17:03:31,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-22 17:03:31,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure ee043155ca80a40107ee5072f0ab82d3, server=jenkins-hbase4.apache.org,40079,1695402113120 in 168 msec 2023-09-22 17:03:31,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-22 17:03:31,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 94f08f37cc4aa12127488f693b5f4732, server=jenkins-hbase4.apache.org,44379,1695402113177 in 167 msec 2023-09-22 17:03:31,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ee043155ca80a40107ee5072f0ab82d3, UNASSIGN in 173 msec 2023-09-22 17:03:31,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-22 17:03:31,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=94f08f37cc4aa12127488f693b5f4732, UNASSIGN in 174 msec 2023-09-22 17:03:31,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402211426"}]},"ts":"1695402211426"} 2023-09-22 17:03:31,427 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-22 17:03:31,429 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-22 17:03:31,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-09-22 17:03:31,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-22 17:03:31,548 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-22 17:03:31,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,552 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,553 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,554 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,557 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:31,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:31,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,558 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 17:03:31,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 17:03:31,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 17:03:31,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,560 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/recovered.edits] 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:31,560 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/recovered.edits] 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:31,560 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:31,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-22 17:03:31,565 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf/263940a9fcbc4d8688187e41f0f80e34 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/cf/263940a9fcbc4d8688187e41f0f80e34 2023-09-22 17:03:31,565 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf/cc63460dfafa426795ec754d4202ddf7 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/cf/cc63460dfafa426795ec754d4202ddf7 2023-09-22 17:03:31,568 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3/recovered.edits/9.seqid 2023-09-22 17:03:31,568 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732/recovered.edits/9.seqid 2023-09-22 17:03:31,569 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/ee043155ca80a40107ee5072f0ab82d3 2023-09-22 17:03:31,569 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testEmptyExportFileSystemState/94f08f37cc4aa12127488f693b5f4732 2023-09-22 17:03:31,569 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-22 17:03:31,569 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-22 17:03:31,570 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-22 17:03:31,573 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922da7cd292aa2f4ab7984d10b17a79b235 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230922da7cd292aa2f4ab7984d10b17a79b235 2023-09-22 17:03:31,574 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922ae5da228b88c49ceb52345f437d126a4 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230922ae5da228b88c49ceb52345f437d126a4 2023-09-22 17:03:31,574 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-22 17:03:31,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,578 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-22 17:03:31,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-22 17:03:31,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,580 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-22 17:03:31,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402211580"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:31,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402211580"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:31,582 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 17:03:31,582 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ee043155ca80a40107ee5072f0ab82d3, NAME => 'testtb-testEmptyExportFileSystemState,,1695402200195.ee043155ca80a40107ee5072f0ab82d3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 94f08f37cc4aa12127488f693b5f4732, NAME => 'testtb-testEmptyExportFileSystemState,1,1695402200195.94f08f37cc4aa12127488f693b5f4732.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 17:03:31,582 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-22 17:03:31,583 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402211583"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:31,584 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-22 17:03:31,586 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-22 17:03:31,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 37 msec 2023-09-22 17:03:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-22 17:03:31,662 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-22 17:03:31,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-22 17:03:31,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:31,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-22 17:03:31,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-22 17:03:31,697 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4609 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:52104 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1808557030_1 at /127.0.0.1:45616 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1808557030_1 at /127.0.0.1:50414 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:34311 from appattempt_1695402119614_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5b8d5d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:46225 from appattempt_1695402119614_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:50434 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1255420478_17 at /127.0.0.1:45624 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:36833 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 179), ProcessCount=168 (was 168), AvailableMemoryMB=929 (was 952) 2023-09-22 17:03:31,697 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-22 17:03:31,716 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=167, ProcessCount=168, AvailableMemoryMB=927 2023-09-22 17:03:31,716 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-22 17:03:31,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-22 17:03:31,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:31,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-22 17:03:31,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-22 17:03:31,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-22 17:03:31,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 17:03:31,723 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:31,723 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:31,724 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee empty. 2023-09-22 17:03:31,724 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c empty. 2023-09-22 17:03:31,724 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:31,724 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:31,724 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-22 17:03:31,736 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-22 17:03:31,737 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => ab103a5f93d235c66a4d9f2cbce2d81c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:31,738 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c232238b5e8c86fea3563d5483017bee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp 2023-09-22 17:03:31,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:31,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:31,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c232238b5e8c86fea3563d5483017bee, disabling compactions & flushes 2023-09-22 17:03:31,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing ab103a5f93d235c66a4d9f2cbce2d81c, disabling compactions & flushes 2023-09-22 17:03:31,755 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:31,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:31,755 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:31,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. after waiting 0 ms 2023-09-22 17:03:31,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:31,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:31,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:31,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. after waiting 0 ms 2023-09-22 17:03:31,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for ab103a5f93d235c66a4d9f2cbce2d81c: 2023-09-22 17:03:31,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:31,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:31,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c232238b5e8c86fea3563d5483017bee: 2023-09-22 17:03:31,758 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-22 17:03:31,759 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402211759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402211759"}]},"ts":"1695402211759"} 2023-09-22 17:03:31,759 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402211759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402211759"}]},"ts":"1695402211759"} 2023-09-22 17:03:31,761 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-22 17:03:31,762 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-22 17:03:31,762 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402211762"}]},"ts":"1695402211762"} 2023-09-22 17:03:31,763 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-22 17:03:31,767 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-22 17:03:31,768 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-22 17:03:31,768 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-22 17:03:31,768 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-22 17:03:31,768 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-22 17:03:31,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, ASSIGN}] 2023-09-22 17:03:31,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, ASSIGN 2023-09-22 17:03:31,771 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, ASSIGN 2023-09-22 17:03:31,772 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40079,1695402113120; forceNewPlan=false, retain=false 2023-09-22 17:03:31,772 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44379,1695402113177; forceNewPlan=false, retain=false 2023-09-22 17:03:31,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 17:03:31,922 INFO [jenkins-hbase4:33079] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-22 17:03:31,925 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ab103a5f93d235c66a4d9f2cbce2d81c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:31,925 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c232238b5e8c86fea3563d5483017bee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:31,925 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402211925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402211925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402211925"}]},"ts":"1695402211925"} 2023-09-22 17:03:31,925 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402211925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402211925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402211925"}]},"ts":"1695402211925"} 2023-09-22 17:03:31,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure ab103a5f93d235c66a4d9f2cbce2d81c, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:03:31,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c232238b5e8c86fea3563d5483017bee, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:32,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 17:03:32,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:32,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab103a5f93d235c66a4d9f2cbce2d81c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.', STARTKEY => '1', ENDKEY => ''} 2023-09-22 17:03:32,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c232238b5e8c86fea3563d5483017bee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.', STARTKEY => '', ENDKEY => '1'} 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. service=AccessControlService 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. service=AccessControlService 2023-09-22 17:03:32,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:32,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,083 INFO [StoreOpener-c232238b5e8c86fea3563d5483017bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,083 INFO [StoreOpener-ab103a5f93d235c66a4d9f2cbce2d81c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,085 DEBUG [StoreOpener-c232238b5e8c86fea3563d5483017bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf 2023-09-22 17:03:32,085 DEBUG [StoreOpener-c232238b5e8c86fea3563d5483017bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf 2023-09-22 17:03:32,085 DEBUG [StoreOpener-ab103a5f93d235c66a4d9f2cbce2d81c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf 2023-09-22 17:03:32,085 DEBUG [StoreOpener-ab103a5f93d235c66a4d9f2cbce2d81c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf 2023-09-22 17:03:32,085 INFO [StoreOpener-c232238b5e8c86fea3563d5483017bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c232238b5e8c86fea3563d5483017bee columnFamilyName cf 2023-09-22 17:03:32,085 INFO [StoreOpener-ab103a5f93d235c66a4d9f2cbce2d81c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab103a5f93d235c66a4d9f2cbce2d81c columnFamilyName cf 2023-09-22 17:03:32,087 INFO [StoreOpener-c232238b5e8c86fea3563d5483017bee-1] regionserver.HStore(310): Store=c232238b5e8c86fea3563d5483017bee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:32,087 INFO [StoreOpener-ab103a5f93d235c66a4d9f2cbce2d81c-1] regionserver.HStore(310): Store=ab103a5f93d235c66a4d9f2cbce2d81c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-22 17:03:32,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:32,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:32,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:32,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-22 17:03:32,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c232238b5e8c86fea3563d5483017bee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62893656, jitterRate=-0.06281149387359619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:32,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c232238b5e8c86fea3563d5483017bee: 2023-09-22 17:03:32,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ab103a5f93d235c66a4d9f2cbce2d81c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61802229, jitterRate=-0.07907502353191376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-22 17:03:32,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ab103a5f93d235c66a4d9f2cbce2d81c: 2023-09-22 17:03:32,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee., pid=109, masterSystemTime=1695402212078 2023-09-22 17:03:32,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c., pid=108, masterSystemTime=1695402212078 2023-09-22 17:03:32,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c232238b5e8c86fea3563d5483017bee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402212094"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402212094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402212094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402212094"}]},"ts":"1695402212094"} 2023-09-22 17:03:32,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:32,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:32,095 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ab103a5f93d235c66a4d9f2cbce2d81c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,095 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402212095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695402212095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695402212095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695402212095"}]},"ts":"1695402212095"} 2023-09-22 17:03:32,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-22 17:03:32,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c232238b5e8c86fea3563d5483017bee, server=jenkins-hbase4.apache.org,44379,1695402113177 in 169 msec 2023-09-22 17:03:32,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-22 17:03:32,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure ab103a5f93d235c66a4d9f2cbce2d81c, server=jenkins-hbase4.apache.org,40079,1695402113120 in 170 msec 2023-09-22 17:03:32,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, ASSIGN in 330 msec 2023-09-22 17:03:32,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-22 17:03:32,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, ASSIGN in 331 msec 2023-09-22 17:03:32,101 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-22 17:03:32,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402212101"}]},"ts":"1695402212101"} 2023-09-22 17:03:32,102 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-22 17:03:32,104 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-22 17:03:32,104 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-22 17:03:32,105 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 17:03:32,107 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:32,107 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:32,107 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:32,107 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:32,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:32,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:32,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:32,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-22 17:03:32,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 390 msec 2023-09-22 17:03:32,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-22 17:03:32,325 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-22 17:03:32,327 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,327 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,329 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:03:32,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 17:03:32,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402212339 (current time:1695402212339). 2023-09-22 17:03:32,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:32,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x22903fc7 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:32,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17c52c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:32,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:32,348 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:32,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22903fc7 to 127.0.0.1:51340 2023-09-22 17:03:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x031c9351 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:32,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d1eaf2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:32,355 DEBUG [hconnection-0x1e488d71-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:32,357 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:32,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x031c9351 to 127.0.0.1:51340 2023-09-22 17:03:32,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:32,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 17:03:32,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:32,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 17:03:32,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 17:03:32,364 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 17:03:32,364 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695402812364 2023-09-22 17:03:32,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 17:03:32,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,366 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:32,366 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:32,367 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 17:03:32,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 17:03:32,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-22 17:03:32,369 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 17:03:32,369 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695402812369 2023-09-22 17:03:32,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,381 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-22 17:03:32,381 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,382 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-22 17:03:32,382 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-22 17:03:32,382 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,382 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,385 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,385 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,385 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,385 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 17:03:32,386 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 17:03:32,386 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 17:03:32,387 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 17:03:32,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 17:03:32,387 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,390 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 17:03:32,390 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 17:03:32,390 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 17:03:32,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,390 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 17:03:32,390 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,390 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 17:03:32,391 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 17:03:32,391 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,391 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 17:03:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 17:03:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 17:03:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 17:03:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 17:03:32,398 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,398 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,398 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,398 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:32,398 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47c20f9a[Count = 1] remaining members to acquire global barrier 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 17:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47c20f9a[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:32,402 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-22 17:03:32,402 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 17:03:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 17:03:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 17:03:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:32,404 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,403 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,404 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:32,404 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. started... 2023-09-22 17:03:32,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,404 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,404 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab103a5f93d235c66a4d9f2cbce2d81c: 2023-09-22 17:03:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. started... 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:03:32,405 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c232238b5e8c86fea3563d5483017bee: 2023-09-22 17:03:32,406 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,406 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:32,406 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-22 17:03:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 17:03:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 17:03:32,417 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. completed. 2023-09-22 17:03:32,417 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 17:03:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:32,418 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. completed. 2023-09-22 17:03:32,418 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 17:03:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:32,420 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 17:03:32,420 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,420 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:32,420 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 17:03:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 17:03:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:32,422 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 17:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-22 17:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-22 17:03:32,430 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-22 17:03:32,430 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:32,430 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:32,430 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,430 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:32,431 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,431 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,431 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:32,432 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,432 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:32,433 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,434 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,435 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,435 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:32,438 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:32,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:32,438 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:32,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:03:32,440 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,441 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,441 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,441 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,441 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,441 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:32,441 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-22 17:03:32,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,466 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:32,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 17:03:32,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:03:32,467 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:03:32,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-22 17:03:32,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,469 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695402212365Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695402212449 (+84 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695402212449Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695402212449Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695402212453 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695402212463 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695402212468 (+5 ms) 2023-09-22 17:03:32,471 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 17:03:32,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 106 msec 2023-09-22 17:03:32,667 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:32,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 17:03:32,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:32,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:03:32,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40079] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-22 17:03:32,673 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,673 DEBUG [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,673 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-22 17:03:32,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 17:03:32,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695402212681 (current time:1695402212681). 2023-09-22 17:03:32,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-22 17:03:32,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x23590aa2 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:32,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@792028bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:32,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:32,693 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:32,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23590aa2 to 127.0.0.1:51340 2023-09-22 17:03:32,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:32,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(139): Connect 0x01512a65 to 127.0.0.1:51340 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-22 17:03:32,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70a1a6d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-22 17:03:32,700 DEBUG [hconnection-0x3e62517c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-22 17:03:32,701 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-22 17:03:32,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01512a65 to 127.0.0.1:51340 2023-09-22 17:03:32,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:03:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-22 17:03:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-22 17:03:32,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 17:03:32,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 17:03:32,709 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 17:03:32,710 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695402812710 2023-09-22 17:03:32,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-22 17:03:32,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,711 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-22 17:03:32,711 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-22 17:03:32,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 17:03:32,712 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-22 17:03:32,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-22 17:03:32,714 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 17:03:32,715 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695402812715 2023-09-22 17:03:32,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,724 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-22 17:03:32,724 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,725 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-22 17:03:32,725 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-22 17:03:32,725 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,725 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,728 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,728 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,728 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,728 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,729 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:32,729 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,729 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,729 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 17:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 17:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-22 17:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 17:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 17:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-22 17:03:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 17:03:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-22 17:03:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 17:03:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-22 17:03:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44467,1695402113218' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 17:03:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 17:03:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-22 17:03:32,735 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,736 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-22 17:03:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44379,1695402113177' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@534aa970[Count = 1] remaining members to acquire global barrier 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40079,1695402113120' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-22 17:03:32,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@534aa970[Count = 0] remaining members to acquire global barrier 2023-09-22 17:03:32,739 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-22 17:03:32,739 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,744 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 17:03:32,744 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 17:03:32,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,744 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:32,745 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-22 17:03:32,745 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 17:03:32,745 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44467,1695402113218' in zk 2023-09-22 17:03:32,745 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,745 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:32,745 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. started... 2023-09-22 17:03:32,745 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,745 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-22 17:03:32,745 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c232238b5e8c86fea3563d5483017bee 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-22 17:03:32,746 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 17:03:32,746 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:32,746 DEBUG [member: 'jenkins-hbase4.apache.org,44467,1695402113218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 17:03:32,749 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-22 17:03:32,750 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-22 17:03:32,750 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:32,750 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. started... 2023-09-22 17:03:32,750 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ab103a5f93d235c66a4d9f2cbce2d81c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-22 17:03:32,769 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230922e3f63dc3e8f9405d855ee469eea481c3 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922e3f63dc3e8f9405d855ee469eea481c3 2023-09-22 17:03:32,775 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/.tmp/cf/4f834b19cd974e279e79603d774161c6 2023-09-22 17:03:32,780 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/.tmp/cf/4f834b19cd974e279e79603d774161c6 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf/4f834b19cd974e279e79603d774161c6 2023-09-22 17:03:32,783 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf/4f834b19cd974e279e79603d774161c6, entries=2, sequenceid=6, filesize=5.2 K 2023-09-22 17:03:32,784 INFO [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c232238b5e8c86fea3563d5483017bee in 39ms, sequenceid=6, compaction requested=false 2023-09-22 17:03:32,784 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-22 17:03:32,785 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c232238b5e8c86fea3563d5483017bee: 2023-09-22 17:03:32,785 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,785 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:32,785 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf/4f834b19cd974e279e79603d774161c6] hfiles 2023-09-22 17:03:32,785 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf/4f834b19cd974e279e79603d774161c6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,791 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. completed. 2023-09-22 17:03:32,791 DEBUG [rs(jenkins-hbase4.apache.org,44379,1695402113177)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 17:03:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44379,1695402113177' in zk 2023-09-22 17:03:32,793 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,793 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 17:03:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:32,793 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:32,793 DEBUG [member: 'jenkins-hbase4.apache.org,44379,1695402113177' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 17:03:32,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:32,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:32,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:32,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44379,1695402113177': 2023-09-22 17:03:32,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44379,1695402113177' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-22 17:03:32,811 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 17:03:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:03:32,812 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-22 17:03:33,013 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:33,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 17:03:33,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-22 17:03:33,014 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-22 17:03:33,172 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309220dd90ef04cbd46ff892bfd9fb32e49dc to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309220dd90ef04cbd46ff892bfd9fb32e49dc 2023-09-22 17:03:33,178 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/.tmp/cf/0e22b2dfbce44349978b340c44dac0d5 2023-09-22 17:03:33,183 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/.tmp/cf/0e22b2dfbce44349978b340c44dac0d5 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf/0e22b2dfbce44349978b340c44dac0d5 2023-09-22 17:03:33,187 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf/0e22b2dfbce44349978b340c44dac0d5, entries=48, sequenceid=6, filesize=13.5 K 2023-09-22 17:03:33,187 INFO [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ab103a5f93d235c66a4d9f2cbce2d81c in 437ms, sequenceid=6, compaction requested=false 2023-09-22 17:03:33,189 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab103a5f93d235c66a4d9f2cbce2d81c: 2023-09-22 17:03:33,189 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,189 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-22 17:03:33,189 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf/0e22b2dfbce44349978b340c44dac0d5] hfiles 2023-09-22 17:03:33,189 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf/0e22b2dfbce44349978b340c44dac0d5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,195 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. completed. 2023-09-22 17:03:33,195 DEBUG [rs(jenkins-hbase4.apache.org,40079,1695402113120)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-22 17:03:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-22 17:03:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-22 17:03:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40079,1695402113120' in zk 2023-09-22 17:03:33,197 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-22 17:03:33,197 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,197 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:33,197 DEBUG [member: 'jenkins-hbase4.apache.org,40079,1695402113120' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-22 17:03:33,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:33,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:33,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40079,1695402113120': 2023-09-22 17:03:33,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40079,1695402113120' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-22 17:03:33,202 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-22 17:03:33,202 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-22 17:03:33,202 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-22 17:03:33,202 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,202 INFO [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-22 17:03:33,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,205 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:33,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,206 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-22 17:03:33,206 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-22 17:03:33,208 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,208 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,208 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:33,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-22 17:03:33,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:33,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:33,211 DEBUG [(jenkins-hbase4.apache.org,33079,1695402111785)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-22 17:03:33,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-22 17:03:33,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-22 17:03:33,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,211 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-22 17:03:33,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:33,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:33,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-22 17:03:33,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-22 17:03:33,213 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,213 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,213 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:03:33,213 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,213 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:33,214 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:33,214 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,214 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309220dd90ef04cbd46ff892bfd9fb32e49dc, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922e3f63dc3e8f9405d855ee469eea481c3] mob files 2023-09-22 17:03:33,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309220dd90ef04cbd46ff892bfd9fb32e49dc 2023-09-22 17:03:33,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922e3f63dc3e8f9405d855ee469eea481c3 2023-09-22 17:03:33,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-22 17:03:33,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,236 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695402212710Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695402213220 (+510 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695402213220Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695402213220Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695402213223 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695402213230 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695402213236 (+6 ms) 2023-09-22 17:03:33,239 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-22 17:03:33,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 528 msec 2023-09-22 17:03:33,314 DEBUG [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-22 17:03:33,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-22 17:03:33,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-22 17:03:33,315 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315 2023-09-22 17:03:33,315 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44043, tgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315, rawTgtDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315, srcFsUri=hdfs://localhost:44043, srcDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:03:33,338 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e 2023-09-22 17:03:33,338 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1725369471_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,338 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44043, inputRoot=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e, snapshotDir=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-22 17:03:33,346 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:33,362 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:33,363 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:33,363 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:33,363 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-3825845834303687922.jar 2023-09-22 17:03:34,235 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,236 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,302 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/hadoop-2055762297189049032.jar 2023-09-22 17:03:34,302 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,303 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,303 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,303 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,304 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,304 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-22 17:03:34,304 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-22 17:03:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-22 17:03:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-22 17:03:34,305 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-22 17:03:34,306 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-22 17:03:34,306 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-22 17:03:34,306 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-22 17:03:34,307 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-22 17:03:34,307 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-22 17:03:34,308 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-22 17:03:34,308 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:34,308 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:34,309 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:34,309 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:34,309 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-22 17:03:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/44767] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-22 17:03:34,634 WARN [Listener at jenkins-hbase4.apache.org/44767] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-22 17:03:34,636 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-22 17:03:34,637 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-22 17:03:35,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:03:35,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-22 17:03:35,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0006_000001 (auth:SIMPLE) 2023-09-22 17:03:36,121 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0007_000001 (auth:SIMPLE) 2023-09-22 17:03:37,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:03:39,831 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0007_000001 (auth:SIMPLE) 2023-09-22 17:03:42,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0007_000001 (auth:SIMPLE) 2023-09-22 17:03:44,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0007_000001 (auth:SIMPLE) 2023-09-22 17:03:45,782 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-22 17:03:45,782 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-22 17:03:45,793 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:45,793 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-22 17:03:45,794 INFO [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-22 17:03:45,794 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:45,794 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-22 17:03:45,794 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-22 17:03:45,794 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1255420478_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:45,795 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-22 17:03:45,795 DEBUG [Listener at jenkins-hbase4.apache.org/44767] snapshot.TestExportSnapshot(367): hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/export-test/export-1695402213315/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-22 17:03:45,800 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:45,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:45,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:45,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 17:03:45,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402225804"}]},"ts":"1695402225804"} 2023-09-22 17:03:45,805 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-22 17:03:45,806 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-22 17:03:45,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, UNASSIGN}] 2023-09-22 17:03:45,809 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, UNASSIGN 2023-09-22 17:03:45,809 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, UNASSIGN 2023-09-22 17:03:45,809 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ab103a5f93d235c66a4d9f2cbce2d81c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:03:45,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c232238b5e8c86fea3563d5483017bee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:03:45,809 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402225809"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402225809"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402225809"}]},"ts":"1695402225809"} 2023-09-22 17:03:45,809 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402225809"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695402225809"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695402225809"}]},"ts":"1695402225809"} 2023-09-22 17:03:45,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure ab103a5f93d235c66a4d9f2cbce2d81c, server=jenkins-hbase4.apache.org,40079,1695402113120}] 2023-09-22 17:03:45,811 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure c232238b5e8c86fea3563d5483017bee, server=jenkins-hbase4.apache.org,44379,1695402113177}] 2023-09-22 17:03:45,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 17:03:45,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:45,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ab103a5f93d235c66a4d9f2cbce2d81c, disabling compactions & flushes 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c232238b5e8c86fea3563d5483017bee, disabling compactions & flushes 2023-09-22 17:03:45,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:45,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. after waiting 0 ms 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. after waiting 0 ms 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:45,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:45,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:45,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:03:45,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:45,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:03:45,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c. 2023-09-22 17:03:45,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee. 2023-09-22 17:03:45,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ab103a5f93d235c66a4d9f2cbce2d81c: 2023-09-22 17:03:45,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c232238b5e8c86fea3563d5483017bee: 2023-09-22 17:03:45,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:45,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ab103a5f93d235c66a4d9f2cbce2d81c, regionState=CLOSED 2023-09-22 17:03:45,977 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402225977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402225977"}]},"ts":"1695402225977"} 2023-09-22 17:03:45,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:45,977 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c232238b5e8c86fea3563d5483017bee, regionState=CLOSED 2023-09-22 17:03:45,978 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695402225977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695402225977"}]},"ts":"1695402225977"} 2023-09-22 17:03:45,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-22 17:03:45,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure ab103a5f93d235c66a4d9f2cbce2d81c, server=jenkins-hbase4.apache.org,40079,1695402113120 in 168 msec 2023-09-22 17:03:45,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-22 17:03:45,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure c232238b5e8c86fea3563d5483017bee, server=jenkins-hbase4.apache.org,44379,1695402113177 in 168 msec 2023-09-22 17:03:45,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ab103a5f93d235c66a4d9f2cbce2d81c, UNASSIGN in 173 msec 2023-09-22 17:03:45,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-22 17:03:45,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c232238b5e8c86fea3563d5483017bee, UNASSIGN in 175 msec 2023-09-22 17:03:45,984 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695402225984"}]},"ts":"1695402225984"} 2023-09-22 17:03:45,985 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-22 17:03:45,987 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-22 17:03:45,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-22 17:03:46,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-22 17:03:46,107 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-22 17:03:46,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,110 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,111 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,112 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40079] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,115 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:46,115 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:46,116 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,116 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,116 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,116 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,117 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/recovered.edits] 2023-09-22 17:03:46,117 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/recovered.edits] 2023-09-22 17:03:46,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 17:03:46,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 17:03:46,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 17:03:46,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:46,118 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,119 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-22 17:03:46,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-22 17:03:46,121 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf/4f834b19cd974e279e79603d774161c6 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/cf/4f834b19cd974e279e79603d774161c6 2023-09-22 17:03:46,122 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf/0e22b2dfbce44349978b340c44dac0d5 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/cf/0e22b2dfbce44349978b340c44dac0d5 2023-09-22 17:03:46,124 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee/recovered.edits/9.seqid 2023-09-22 17:03:46,125 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/recovered.edits/9.seqid to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c/recovered.edits/9.seqid 2023-09-22 17:03:46,125 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c232238b5e8c86fea3563d5483017bee 2023-09-22 17:03:46,125 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ab103a5f93d235c66a4d9f2cbce2d81c 2023-09-22 17:03:46,125 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-22 17:03:46,126 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-22 17:03:46,126 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-22 17:03:46,129 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309220dd90ef04cbd46ff892bfd9fb32e49dc to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309220dd90ef04cbd46ff892bfd9fb32e49dc 2023-09-22 17:03:46,131 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922e3f63dc3e8f9405d855ee469eea481c3 to hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230922e3f63dc3e8f9405d855ee469eea481c3 2023-09-22 17:03:46,131 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-22 17:03:46,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,135 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-22 17:03:46,136 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-22 17:03:46,137 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,137 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-22 17:03:46,138 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402226137"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:46,138 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695402226137"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:46,139 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-22 17:03:46,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c232238b5e8c86fea3563d5483017bee, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695402211718.c232238b5e8c86fea3563d5483017bee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ab103a5f93d235c66a4d9f2cbce2d81c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695402211718.ab103a5f93d235c66a4d9f2cbce2d81c.', STARTKEY => '1', ENDKEY => ''}] 2023-09-22 17:03:46,139 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-22 17:03:46,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695402226139"}]},"ts":"9223372036854775807"} 2023-09-22 17:03:46,141 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-22 17:03:46,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-22 17:03:46,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-22 17:03:46,220 INFO [Listener at jenkins-hbase4.apache.org/44767] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-22 17:03:46,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-22 17:03:46,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-22 17:03:46,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33079] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-22 17:03:46,254 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=910 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 167), ProcessCount=168 (was 168), AvailableMemoryMB=1013 (was 927) - AvailableMemoryMB LEAK? - 2023-09-22 17:03:46,255 WARN [Listener at jenkins-hbase4.apache.org/44767] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-22 17:03:46,255 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-22 17:03:46,264 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 17:03:50,747 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695402119614_0007_000001 (auth:SIMPLE) 2023-09-22 17:03:51,547 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-22 17:04:00,388 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 17:04:14,504 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 17:04:14,505 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 17:04:14,612 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-22 17:04:14,621 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-22 17:04:14,622 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 17:04:14,631 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-22 17:04:14,735 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-22 17:04:14,735 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-22 17:04:14,735 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-22 17:04:14,735 INFO [Listener at jenkins-hbase4.apache.org/44767] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-22 17:04:14,735 DEBUG [Listener at jenkins-hbase4.apache.org/44767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x782e04b0 to 127.0.0.1:51340 2023-09-22 17:04:14,735 DEBUG [Listener at jenkins-hbase4.apache.org/44767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,735 DEBUG [Listener at jenkins-hbase4.apache.org/44767] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-22 17:04:14,735 DEBUG [Listener at jenkins-hbase4.apache.org/44767] util.JVMClusterUtil(257): Found active master hash=449485541, stopped=false 2023-09-22 17:04:14,736 DEBUG [Listener at jenkins-hbase4.apache.org/44767] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,736 DEBUG [Listener at jenkins-hbase4.apache.org/44767] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-22 17:04:14,736 INFO [Listener at jenkins-hbase4.apache.org/44767] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:04:14,737 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 17:04:14,737 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 17:04:14,737 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 17:04:14,737 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:04:14,737 INFO [Listener at jenkins-hbase4.apache.org/44767] procedure2.ProcedureExecutor(628): Stopping 2023-09-22 17:04:14,737 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-22 17:04:14,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:04:14,738 DEBUG [Listener at jenkins-hbase4.apache.org/44767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7817b55b to 127.0.0.1:51340 2023-09-22 17:04:14,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:04:14,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:04:14,738 DEBUG [Listener at jenkins-hbase4.apache.org/44767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-22 17:04:14,738 INFO [Listener at jenkins-hbase4.apache.org/44767] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40079,1695402113120' ***** 2023-09-22 17:04:14,739 DEBUG [Listener at jenkins-hbase4.apache.org/44767] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,739 INFO [Listener at jenkins-hbase4.apache.org/44767] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 17:04:14,739 INFO [Listener at jenkins-hbase4.apache.org/44767] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44379,1695402113177' ***** 2023-09-22 17:04:14,739 DEBUG [Listener at jenkins-hbase4.apache.org/44767] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,739 INFO [Listener at jenkins-hbase4.apache.org/44767] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 17:04:14,739 INFO [RS:0;jenkins-hbase4:40079] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 17:04:14,739 INFO [Listener at jenkins-hbase4.apache.org/44767] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44467,1695402113218' ***** 2023-09-22 17:04:14,739 DEBUG [Listener at jenkins-hbase4.apache.org/44767] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,739 INFO [RS:1;jenkins-hbase4:44379] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 17:04:14,739 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 17:04:14,739 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 17:04:14,739 INFO [RS:0;jenkins-hbase4:40079] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 17:04:14,739 INFO [RS:1;jenkins-hbase4:44379] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 17:04:14,739 INFO [RS:0;jenkins-hbase4:40079] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 17:04:14,739 INFO [Listener at jenkins-hbase4.apache.org/44767] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-22 17:04:14,739 INFO [RS:1;jenkins-hbase4:44379] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 17:04:14,740 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:04:14,740 INFO [RS:2;jenkins-hbase4:44467] regionserver.HeapMemoryManager(220): Stopping 2023-09-22 17:04:14,740 DEBUG [RS:1;jenkins-hbase4:44379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cbc9d46 to 127.0.0.1:51340 2023-09-22 17:04:14,740 INFO [RS:2;jenkins-hbase4:44467] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-22 17:04:14,740 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(3305): Received CLOSE for 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:04:14,740 INFO [RS:2;jenkins-hbase4:44467] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-22 17:04:14,740 DEBUG [RS:1;jenkins-hbase4:44379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,740 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-22 17:04:14,740 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(3305): Received CLOSE for 98bbded44a602da5054b9c48041738c8 2023-09-22 17:04:14,741 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:04:14,741 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:04:14,742 DEBUG [RS:0;jenkins-hbase4:40079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25d1d127 to 127.0.0.1:51340 2023-09-22 17:04:14,742 DEBUG [RS:2;jenkins-hbase4:44467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x608cbf4b to 127.0.0.1:51340 2023-09-22 17:04:14,741 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44379,1695402113177; all regions closed. 2023-09-22 17:04:14,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98bbded44a602da5054b9c48041738c8, disabling compactions & flushes 2023-09-22 17:04:14,742 DEBUG [RS:2;jenkins-hbase4:44467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 64c2b6478c2f8e5f520ee2637307e0b2, disabling compactions & flushes 2023-09-22 17:04:14,742 DEBUG [RS:0;jenkins-hbase4:40079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,744 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-22 17:04:14,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:04:14,745 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1478): Online Regions={98bbded44a602da5054b9c48041738c8=hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8.} 2023-09-22 17:04:14,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:04:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:04:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:04:14,745 INFO [RS:0;jenkins-hbase4:40079] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 17:04:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. after waiting 0 ms 2023-09-22 17:04:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. after waiting 0 ms 2023-09-22 17:04:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:04:14,745 INFO [RS:0;jenkins-hbase4:40079] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 17:04:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:04:14,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 64c2b6478c2f8e5f520ee2637307e0b2 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-22 17:04:14,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 98bbded44a602da5054b9c48041738c8 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-22 17:04:14,745 INFO [RS:0;jenkins-hbase4:40079] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 17:04:14,745 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-22 17:04:14,746 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-22 17:04:14,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-22 17:04:14,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-22 17:04:14,746 DEBUG [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1504): Waiting on 98bbded44a602da5054b9c48041738c8 2023-09-22 17:04:14,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-22 17:04:14,746 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-22 17:04:14,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-22 17:04:14,747 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 64c2b6478c2f8e5f520ee2637307e0b2=hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2.} 2023-09-22 17:04:14,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-22 17:04:14,747 DEBUG [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1504): Waiting on 1588230740, 64c2b6478c2f8e5f520ee2637307e0b2 2023-09-22 17:04:14,762 DEBUG [RS:1;jenkins-hbase4:44379] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs 2023-09-22 17:04:14,762 INFO [RS:1;jenkins-hbase4:44379] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44379%2C1695402113177:(num 1695402114846) 2023-09-22 17:04:14,762 DEBUG [RS:1;jenkins-hbase4:44379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,762 INFO [RS:1;jenkins-hbase4:44379] regionserver.LeaseManager(133): Closed leases 2023-09-22 17:04:14,766 INFO [RS:1;jenkins-hbase4:44379] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-22 17:04:14,766 INFO [RS:1;jenkins-hbase4:44379] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 17:04:14,766 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 17:04:14,767 INFO [RS:1;jenkins-hbase4:44379] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 17:04:14,767 INFO [RS:1;jenkins-hbase4:44379] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 17:04:14,771 INFO [RS:1;jenkins-hbase4:44379] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44379 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44379,1695402113177 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:04:14,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/.tmp/l/1ad82409bf2a4017bbb77546e155f238 2023-09-22 17:04:14,777 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:04:14,778 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44379,1695402113177] 2023-09-22 17:04:14,779 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44379,1695402113177; numProcessing=1 2023-09-22 17:04:14,781 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/.tmp/info/a8046dc880b84e2494d04423be83c324 2023-09-22 17:04:14,782 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44379,1695402113177 already deleted, retry=false 2023-09-22 17:04:14,782 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44379,1695402113177 expired; onlineServers=2 2023-09-22 17:04:14,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/.tmp/info/2f21ffe5954e41ca8c3f770012fa1ecc 2023-09-22 17:04:14,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ad82409bf2a4017bbb77546e155f238 2023-09-22 17:04:14,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/.tmp/l/1ad82409bf2a4017bbb77546e155f238 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/l/1ad82409bf2a4017bbb77546e155f238 2023-09-22 17:04:14,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8046dc880b84e2494d04423be83c324 2023-09-22 17:04:14,788 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 17:04:14,788 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 17:04:14,788 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-22 17:04:14,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/.tmp/info/2f21ffe5954e41ca8c3f770012fa1ecc as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/info/2f21ffe5954e41ca8c3f770012fa1ecc 2023-09-22 17:04:14,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ad82409bf2a4017bbb77546e155f238 2023-09-22 17:04:14,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/l/1ad82409bf2a4017bbb77546e155f238, entries=7, sequenceid=18, filesize=5.2 K 2023-09-22 17:04:14,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 64c2b6478c2f8e5f520ee2637307e0b2 in 54ms, sequenceid=18, compaction requested=false 2023-09-22 17:04:14,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/info/2f21ffe5954e41ca8c3f770012fa1ecc, entries=2, sequenceid=6, filesize=4.8 K 2023-09-22 17:04:14,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 98bbded44a602da5054b9c48041738c8 in 55ms, sequenceid=6, compaction requested=false 2023-09-22 17:04:14,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/.tmp/rep_barrier/69234c803ee544449504bf25e24b7a09 2023-09-22 17:04:14,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/acl/64c2b6478c2f8e5f520ee2637307e0b2/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-22 17:04:14,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/namespace/98bbded44a602da5054b9c48041738c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-22 17:04:14,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:04:14,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:04:14,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 64c2b6478c2f8e5f520ee2637307e0b2: 2023-09-22 17:04:14,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98bbded44a602da5054b9c48041738c8: 2023-09-22 17:04:14,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695402115326.98bbded44a602da5054b9c48041738c8. 2023-09-22 17:04:14,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695402116078.64c2b6478c2f8e5f520ee2637307e0b2. 2023-09-22 17:04:14,818 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69234c803ee544449504bf25e24b7a09 2023-09-22 17:04:14,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/.tmp/table/547a8e7fbf5a4bf986a3a0c578ce1061 2023-09-22 17:04:14,831 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 547a8e7fbf5a4bf986a3a0c578ce1061 2023-09-22 17:04:14,832 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/.tmp/info/a8046dc880b84e2494d04423be83c324 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/info/a8046dc880b84e2494d04423be83c324 2023-09-22 17:04:14,836 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8046dc880b84e2494d04423be83c324 2023-09-22 17:04:14,836 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/info/a8046dc880b84e2494d04423be83c324, entries=48, sequenceid=131, filesize=10.3 K 2023-09-22 17:04:14,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/.tmp/rep_barrier/69234c803ee544449504bf25e24b7a09 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/rep_barrier/69234c803ee544449504bf25e24b7a09 2023-09-22 17:04:14,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69234c803ee544449504bf25e24b7a09 2023-09-22 17:04:14,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/rep_barrier/69234c803ee544449504bf25e24b7a09, entries=13, sequenceid=131, filesize=6.4 K 2023-09-22 17:04:14,841 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/.tmp/table/547a8e7fbf5a4bf986a3a0c578ce1061 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/table/547a8e7fbf5a4bf986a3a0c578ce1061 2023-09-22 17:04:14,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 547a8e7fbf5a4bf986a3a0c578ce1061 2023-09-22 17:04:14,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/table/547a8e7fbf5a4bf986a3a0c578ce1061, entries=24, sequenceid=131, filesize=6.9 K 2023-09-22 17:04:14,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 98ms, sequenceid=131, compaction requested=false 2023-09-22 17:04:14,856 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-22 17:04:14,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-22 17:04:14,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-22 17:04:14,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-22 17:04:14,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-22 17:04:14,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-22 17:04:14,880 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:14,880 INFO [RS:1;jenkins-hbase4:44379] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44379,1695402113177; zookeeper connection closed. 2023-09-22 17:04:14,880 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100d49667260002, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:14,880 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7a85ab66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7a85ab66 2023-09-22 17:04:14,947 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44467,1695402113218; all regions closed. 2023-09-22 17:04:14,947 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40079,1695402113120; all regions closed. 2023-09-22 17:04:14,956 DEBUG [RS:2;jenkins-hbase4:44467] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs 2023-09-22 17:04:14,956 INFO [RS:2;jenkins-hbase4:44467] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44467%2C1695402113218:(num 1695402114846) 2023-09-22 17:04:14,956 DEBUG [RS:2;jenkins-hbase4:44467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,956 INFO [RS:2;jenkins-hbase4:44467] regionserver.LeaseManager(133): Closed leases 2023-09-22 17:04:14,957 INFO [RS:2;jenkins-hbase4:44467] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-22 17:04:14,957 INFO [RS:2;jenkins-hbase4:44467] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-22 17:04:14,957 INFO [RS:2;jenkins-hbase4:44467] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-22 17:04:14,957 INFO [RS:2;jenkins-hbase4:44467] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-22 17:04:14,957 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 17:04:14,958 DEBUG [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs 2023-09-22 17:04:14,958 INFO [RS:2;jenkins-hbase4:44467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44467 2023-09-22 17:04:14,958 INFO [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40079%2C1695402113120.meta:.meta(num 1695402115060) 2023-09-22 17:04:14,961 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:04:14,961 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:04:14,961 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44467,1695402113218 2023-09-22 17:04:14,961 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44467,1695402113218] 2023-09-22 17:04:14,962 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44467,1695402113218; numProcessing=2 2023-09-22 17:04:14,963 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44467,1695402113218 already deleted, retry=false 2023-09-22 17:04:14,963 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44467,1695402113218 expired; onlineServers=1 2023-09-22 17:04:14,965 DEBUG [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/oldWALs 2023-09-22 17:04:14,965 INFO [RS:0;jenkins-hbase4:40079] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40079%2C1695402113120:(num 1695402114846) 2023-09-22 17:04:14,965 DEBUG [RS:0;jenkins-hbase4:40079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,965 INFO [RS:0;jenkins-hbase4:40079] regionserver.LeaseManager(133): Closed leases 2023-09-22 17:04:14,965 INFO [RS:0;jenkins-hbase4:40079] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-22 17:04:14,965 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 17:04:14,966 INFO [RS:0;jenkins-hbase4:40079] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40079 2023-09-22 17:04:14,968 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40079,1695402113120 2023-09-22 17:04:14,968 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-22 17:04:14,969 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40079,1695402113120] 2023-09-22 17:04:14,969 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40079,1695402113120; numProcessing=3 2023-09-22 17:04:14,970 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40079,1695402113120 already deleted, retry=false 2023-09-22 17:04:14,970 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40079,1695402113120 expired; onlineServers=0 2023-09-22 17:04:14,970 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33079,1695402111785' ***** 2023-09-22 17:04:14,970 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-22 17:04:14,970 DEBUG [M:0;jenkins-hbase4:33079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf790de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-22 17:04:14,971 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33079,1695402111785 2023-09-22 17:04:14,971 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33079,1695402111785; all regions closed. 2023-09-22 17:04:14,971 DEBUG [M:0;jenkins-hbase4:33079] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-22 17:04:14,971 DEBUG [M:0;jenkins-hbase4:33079] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-22 17:04:14,971 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-22 17:04:14,971 DEBUG [M:0;jenkins-hbase4:33079] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-22 17:04:14,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695402114509] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695402114509,5,FailOnTimeoutGroup] 2023-09-22 17:04:14,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695402114508] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695402114508,5,FailOnTimeoutGroup] 2023-09-22 17:04:14,971 INFO [M:0;jenkins-hbase4:33079] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-22 17:04:14,971 INFO [M:0;jenkins-hbase4:33079] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-22 17:04:14,971 INFO [M:0;jenkins-hbase4:33079] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-22 17:04:14,971 DEBUG [M:0;jenkins-hbase4:33079] master.HMaster(1512): Stopping service threads 2023-09-22 17:04:14,971 INFO [M:0;jenkins-hbase4:33079] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-22 17:04:14,972 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-22 17:04:14,972 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-22 17:04:14,972 ERROR [M:0;jenkins-hbase4:33079] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-22 17:04:14,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-22 17:04:14,972 INFO [M:0;jenkins-hbase4:33079] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-22 17:04:14,973 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-22 17:04:14,973 DEBUG [M:0;jenkins-hbase4:33079] zookeeper.ZKUtil(398): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-22 17:04:14,973 WARN [M:0;jenkins-hbase4:33079] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-22 17:04:14,973 INFO [M:0;jenkins-hbase4:33079] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-22 17:04:14,973 INFO [M:0;jenkins-hbase4:33079] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-22 17:04:14,974 DEBUG [M:0;jenkins-hbase4:33079] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-22 17:04:14,974 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:04:14,974 DEBUG [M:0;jenkins-hbase4:33079] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:04:14,974 DEBUG [M:0;jenkins-hbase4:33079] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-22 17:04:14,974 DEBUG [M:0;jenkins-hbase4:33079] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:04:14,974 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.91 KB 2023-09-22 17:04:14,989 INFO [M:0;jenkins-hbase4:33079] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1126bc554eda478ba9f9cbf4e820c934 2023-09-22 17:04:14,993 INFO [M:0;jenkins-hbase4:33079] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1126bc554eda478ba9f9cbf4e820c934 2023-09-22 17:04:14,993 DEBUG [M:0;jenkins-hbase4:33079] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1126bc554eda478ba9f9cbf4e820c934 as hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1126bc554eda478ba9f9cbf4e820c934 2023-09-22 17:04:14,997 INFO [M:0;jenkins-hbase4:33079] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1126bc554eda478ba9f9cbf4e820c934 2023-09-22 17:04:14,997 INFO [M:0;jenkins-hbase4:33079] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/0abe7777-f5d7-250d-7eac-3bf23b3c685e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1126bc554eda478ba9f9cbf4e820c934, entries=119, sequenceid=899, filesize=28.6 K 2023-09-22 17:04:14,998 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384669, heapSize ~451.90 KB/462744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-22 17:04:15,000 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-22 17:04:15,000 DEBUG [M:0;jenkins-hbase4:33079] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-22 17:04:15,003 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-22 17:04:15,003 INFO [M:0;jenkins-hbase4:33079] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-22 17:04:15,004 INFO [M:0;jenkins-hbase4:33079] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33079 2023-09-22 17:04:15,007 DEBUG [M:0;jenkins-hbase4:33079] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33079,1695402111785 already deleted, retry=false 2023-09-22 17:04:15,064 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:15,064 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:44467-0x100d49667260003, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:15,064 INFO [RS:2;jenkins-hbase4:44467] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44467,1695402113218; zookeeper connection closed. 2023-09-22 17:04:15,064 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3535d98d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3535d98d 2023-09-22 17:04:15,164 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:15,164 INFO [M:0;jenkins-hbase4:33079] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33079,1695402111785; zookeeper connection closed. 2023-09-22 17:04:15,164 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): master:33079-0x100d49667260000, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:15,264 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:15,265 DEBUG [Listener at localhost/37331-EventThread] zookeeper.ZKWatcher(600): regionserver:40079-0x100d49667260001, quorum=127.0.0.1:51340, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-22 17:04:15,264 INFO [RS:0;jenkins-hbase4:40079] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40079,1695402113120; zookeeper connection closed. 2023-09-22 17:04:15,265 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2675671] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2675671 2023-09-22 17:04:15,265 INFO [Listener at jenkins-hbase4.apache.org/44767] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-22 17:04:15,265 WARN [Listener at jenkins-hbase4.apache.org/44767] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 17:04:15,268 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 17:04:15,371 WARN [BP-1250153108-172.31.14.131-1695402108093 heartbeating to localhost/127.0.0.1:44043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 17:04:15,371 WARN [BP-1250153108-172.31.14.131-1695402108093 heartbeating to localhost/127.0.0.1:44043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1250153108-172.31.14.131-1695402108093 (Datanode Uuid 7c65220d-1d92-4fd4-8d03-ea90c3400867) service to localhost/127.0.0.1:44043 2023-09-22 17:04:15,373 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data5/current/BP-1250153108-172.31.14.131-1695402108093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 17:04:15,374 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data6/current/BP-1250153108-172.31.14.131-1695402108093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 17:04:15,375 WARN [Listener at jenkins-hbase4.apache.org/44767] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 17:04:15,376 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 17:04:15,480 WARN [BP-1250153108-172.31.14.131-1695402108093 heartbeating to localhost/127.0.0.1:44043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 17:04:15,480 WARN [BP-1250153108-172.31.14.131-1695402108093 heartbeating to localhost/127.0.0.1:44043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1250153108-172.31.14.131-1695402108093 (Datanode Uuid 0a738b8f-b791-4e7d-95ea-c7d0bc85ee8a) service to localhost/127.0.0.1:44043 2023-09-22 17:04:15,481 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data3/current/BP-1250153108-172.31.14.131-1695402108093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 17:04:15,482 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data4/current/BP-1250153108-172.31.14.131-1695402108093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 17:04:15,483 WARN [Listener at jenkins-hbase4.apache.org/44767] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-22 17:04:15,486 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 17:04:15,588 WARN [BP-1250153108-172.31.14.131-1695402108093 heartbeating to localhost/127.0.0.1:44043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-22 17:04:15,588 WARN [BP-1250153108-172.31.14.131-1695402108093 heartbeating to localhost/127.0.0.1:44043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1250153108-172.31.14.131-1695402108093 (Datanode Uuid bdbdc702-9080-43e4-9380-69efcacc7913) service to localhost/127.0.0.1:44043 2023-09-22 17:04:15,589 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data1/current/BP-1250153108-172.31.14.131-1695402108093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 17:04:15,589 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a84d3883-cd48-4ea6-c8cf-1a1d49f31cb2/cluster_da37b8b0-afc8-69b9-842a-394ed2763b7f/dfs/data/data2/current/BP-1250153108-172.31.14.131-1695402108093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-22 17:04:15,610 INFO [Listener at jenkins-hbase4.apache.org/44767] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-22 17:04:15,738 INFO [Listener at jenkins-hbase4.apache.org/44767] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-22 17:04:15,827 INFO [Listener at jenkins-hbase4.apache.org/44767] hbase.HBaseTestingUtility(1293): Minicluster is down