2023-07-17 21:10:36,143 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 21:10:36,391 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094 2023-07-17 21:10:36,391 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-17 21:10:36,392 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-17 21:10:36,441 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 21:10:36,744 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 21:10:36,745 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2, deleteOnExit=true 2023-07-17 21:10:36,745 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 21:10:36,746 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/test.cache.data in system properties and HBase conf 2023-07-17 21:10:36,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 21:10:36,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop.log.dir in system properties and HBase conf 2023-07-17 21:10:36,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 21:10:36,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 21:10:36,749 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 21:10:37,146 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 21:10:37,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:37,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:37,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 21:10:37,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:37,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 21:10:37,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 21:10:37,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:37,156 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:37,156 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 21:10:37,157 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/nfs.dump.dir in system properties and HBase conf 2023-07-17 21:10:37,157 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir in system properties and HBase conf 2023-07-17 21:10:37,157 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:37,158 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 21:10:37,158 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 21:10:37,843 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 21:10:37,847 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 21:10:38,220 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 21:10:38,430 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 21:10:38,448 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:38,489 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:38,526 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_localhost_33889_hdfs____k94dqb/webapp 2023-07-17 21:10:38,689 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33889 2023-07-17 21:10:38,705 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 21:10:38,705 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 21:10:39,329 WARN [Listener at localhost/34459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:39,437 WARN [Listener at localhost/34459] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 21:10:39,472 WARN [Listener at localhost/34459] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:39,543 INFO [Listener at localhost/34459] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:39,550 INFO [Listener at localhost/34459] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_localhost_36169_datanode____d96u3c/webapp 2023-07-17 21:10:39,656 INFO [Listener at localhost/34459] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36169 2023-07-17 21:10:40,170 WARN [Listener at localhost/42275] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:40,261 WARN [Listener at localhost/42275] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 21:10:40,270 WARN [Listener at localhost/42275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:40,273 INFO [Listener at localhost/42275] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:40,287 INFO [Listener at localhost/42275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_localhost_42795_datanode____8i858/webapp 2023-07-17 21:10:40,432 INFO [Listener at localhost/42275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42795 2023-07-17 21:10:40,463 WARN [Listener at localhost/44061] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:40,521 WARN [Listener at localhost/44061] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 21:10:40,525 WARN [Listener at localhost/44061] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:40,531 INFO [Listener at localhost/44061] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:40,546 INFO [Listener at localhost/44061] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_localhost_41755_datanode____.swnt0f/webapp 2023-07-17 21:10:40,756 INFO [Listener at localhost/44061] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41755 2023-07-17 21:10:40,786 WARN [Listener at localhost/39161] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:41,188 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe07ae78ebb4fc754: Processing first storage report for DS-630c63bb-fdf3-496b-ac17-20065fb43978 from datanode 37a9f4dd-33b2-4e15-b7cf-47cc1cf4ff2a 2023-07-17 21:10:41,190 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe07ae78ebb4fc754: from storage DS-630c63bb-fdf3-496b-ac17-20065fb43978 node DatanodeRegistration(127.0.0.1:45759, datanodeUuid=37a9f4dd-33b2-4e15-b7cf-47cc1cf4ff2a, infoPort=36701, infoSecurePort=0, ipcPort=39161, storageInfo=lv=-57;cid=testClusterID;nsid=1021366576;c=1689628237940), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,190 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa4b1821d5acfaf20: Processing first storage report for DS-041dafb5-fb26-4e6c-bca0-9479014300fd from datanode 0b08c494-e18e-472b-bb5c-9e6c6968456d 2023-07-17 21:10:41,190 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa4b1821d5acfaf20: from storage DS-041dafb5-fb26-4e6c-bca0-9479014300fd node DatanodeRegistration(127.0.0.1:40877, datanodeUuid=0b08c494-e18e-472b-bb5c-9e6c6968456d, infoPort=36533, infoSecurePort=0, ipcPort=42275, storageInfo=lv=-57;cid=testClusterID;nsid=1021366576;c=1689628237940), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x84fd779a3f7e8403: Processing first storage report for DS-12034e26-99d2-409d-8bdf-9f93685fcfb3 from datanode 8cf3b4fe-fb08-4fc0-8217-c60dc0fab90b 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x84fd779a3f7e8403: from storage DS-12034e26-99d2-409d-8bdf-9f93685fcfb3 node DatanodeRegistration(127.0.0.1:42205, datanodeUuid=8cf3b4fe-fb08-4fc0-8217-c60dc0fab90b, infoPort=38203, infoSecurePort=0, ipcPort=44061, storageInfo=lv=-57;cid=testClusterID;nsid=1021366576;c=1689628237940), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe07ae78ebb4fc754: Processing first storage report for DS-cdb034c5-78c3-44d8-8df1-a6a27a117dda from datanode 37a9f4dd-33b2-4e15-b7cf-47cc1cf4ff2a 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe07ae78ebb4fc754: from storage DS-cdb034c5-78c3-44d8-8df1-a6a27a117dda node DatanodeRegistration(127.0.0.1:45759, datanodeUuid=37a9f4dd-33b2-4e15-b7cf-47cc1cf4ff2a, infoPort=36701, infoSecurePort=0, ipcPort=39161, storageInfo=lv=-57;cid=testClusterID;nsid=1021366576;c=1689628237940), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa4b1821d5acfaf20: Processing first storage report for DS-cac22481-388a-49e1-8550-4a01d4181379 from datanode 0b08c494-e18e-472b-bb5c-9e6c6968456d 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa4b1821d5acfaf20: from storage DS-cac22481-388a-49e1-8550-4a01d4181379 node DatanodeRegistration(127.0.0.1:40877, datanodeUuid=0b08c494-e18e-472b-bb5c-9e6c6968456d, infoPort=36533, infoSecurePort=0, ipcPort=42275, storageInfo=lv=-57;cid=testClusterID;nsid=1021366576;c=1689628237940), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x84fd779a3f7e8403: Processing first storage report for DS-3eaa328c-2f5d-48dd-931e-3e3b27efdff3 from datanode 8cf3b4fe-fb08-4fc0-8217-c60dc0fab90b 2023-07-17 21:10:41,191 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x84fd779a3f7e8403: from storage DS-3eaa328c-2f5d-48dd-931e-3e3b27efdff3 node DatanodeRegistration(127.0.0.1:42205, datanodeUuid=8cf3b4fe-fb08-4fc0-8217-c60dc0fab90b, infoPort=38203, infoSecurePort=0, ipcPort=44061, storageInfo=lv=-57;cid=testClusterID;nsid=1021366576;c=1689628237940), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,427 DEBUG [Listener at localhost/39161] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094 2023-07-17 21:10:41,546 INFO [Listener at localhost/39161] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/zookeeper_0, clientPort=60809, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 21:10:41,573 INFO [Listener at localhost/39161] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60809 2023-07-17 21:10:41,585 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:41,589 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:42,323 INFO [Listener at localhost/39161] util.FSUtils(471): Created version file at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 with version=8 2023-07-17 21:10:42,324 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/hbase-staging 2023-07-17 21:10:42,722 INFO [Listener at localhost/39161] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 21:10:43,326 INFO [Listener at localhost/39161] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:43,360 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:43,360 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:43,360 INFO [Listener at localhost/39161] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:43,361 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:43,361 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:43,524 INFO [Listener at localhost/39161] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:43,604 DEBUG [Listener at localhost/39161] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 21:10:43,702 INFO [Listener at localhost/39161] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33275 2023-07-17 21:10:43,720 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:43,722 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:43,750 INFO [Listener at localhost/39161] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33275 connecting to ZooKeeper ensemble=127.0.0.1:60809 2023-07-17 21:10:43,829 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:332750x0, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:43,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33275-0x101751f716f0000 connected 2023-07-17 21:10:43,900 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:43,901 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:43,917 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:43,926 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33275 2023-07-17 21:10:43,927 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33275 2023-07-17 21:10:43,927 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33275 2023-07-17 21:10:43,928 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33275 2023-07-17 21:10:43,928 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33275 2023-07-17 21:10:43,938 INFO [Listener at localhost/39161] master.HMaster(444): hbase.rootdir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, hbase.cluster.distributed=false 2023-07-17 21:10:44,013 INFO [Listener at localhost/39161] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:44,013 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,013 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,013 INFO [Listener at localhost/39161] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:44,013 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,013 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:44,018 INFO [Listener at localhost/39161] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:44,022 INFO [Listener at localhost/39161] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46043 2023-07-17 21:10:44,025 INFO [Listener at localhost/39161] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 21:10:44,039 INFO [Listener at localhost/39161] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 21:10:44,041 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,044 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,046 INFO [Listener at localhost/39161] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46043 connecting to ZooKeeper ensemble=127.0.0.1:60809 2023-07-17 21:10:44,051 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:460430x0, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:44,053 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:460430x0, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:44,058 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:460430x0, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:44,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46043-0x101751f716f0001 connected 2023-07-17 21:10:44,059 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:44,071 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46043 2023-07-17 21:10:44,076 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46043 2023-07-17 21:10:44,077 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46043 2023-07-17 21:10:44,077 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46043 2023-07-17 21:10:44,082 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46043 2023-07-17 21:10:44,096 INFO [Listener at localhost/39161] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:44,096 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,096 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,097 INFO [Listener at localhost/39161] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:44,097 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,097 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:44,098 INFO [Listener at localhost/39161] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:44,099 INFO [Listener at localhost/39161] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39595 2023-07-17 21:10:44,100 INFO [Listener at localhost/39161] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 21:10:44,102 INFO [Listener at localhost/39161] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 21:10:44,103 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,106 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,110 INFO [Listener at localhost/39161] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39595 connecting to ZooKeeper ensemble=127.0.0.1:60809 2023-07-17 21:10:44,115 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:395950x0, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:44,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39595-0x101751f716f0002 connected 2023-07-17 21:10:44,117 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:44,120 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:44,121 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:44,126 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39595 2023-07-17 21:10:44,130 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39595 2023-07-17 21:10:44,134 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39595 2023-07-17 21:10:44,138 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39595 2023-07-17 21:10:44,138 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39595 2023-07-17 21:10:44,151 INFO [Listener at localhost/39161] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:44,151 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,151 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,151 INFO [Listener at localhost/39161] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:44,151 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,151 INFO [Listener at localhost/39161] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:44,152 INFO [Listener at localhost/39161] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:44,156 INFO [Listener at localhost/39161] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44933 2023-07-17 21:10:44,156 INFO [Listener at localhost/39161] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 21:10:44,159 INFO [Listener at localhost/39161] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 21:10:44,160 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,162 INFO [Listener at localhost/39161] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,164 INFO [Listener at localhost/39161] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44933 connecting to ZooKeeper ensemble=127.0.0.1:60809 2023-07-17 21:10:44,168 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:449330x0, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:44,169 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:449330x0, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:44,170 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:449330x0, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:44,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44933-0x101751f716f0003 connected 2023-07-17 21:10:44,171 DEBUG [Listener at localhost/39161] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:44,175 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44933 2023-07-17 21:10:44,176 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44933 2023-07-17 21:10:44,178 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44933 2023-07-17 21:10:44,183 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44933 2023-07-17 21:10:44,183 DEBUG [Listener at localhost/39161] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44933 2023-07-17 21:10:44,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:44,200 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 21:10:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:44,230 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,230 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,230 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,230 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,230 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:44,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 21:10:44,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 21:10:44,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33275,1689628242520 from backup master directory 2023-07-17 21:10:44,242 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:44,243 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 21:10:44,244 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:44,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:44,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 21:10:44,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 21:10:44,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/hbase.id with ID: eccd7c60-c16e-4a69-bc09-fcfc879b2a85 2023-07-17 21:10:44,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,485 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:44,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06e566fa to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:44,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e6a7f3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:44,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:44,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 21:10:44,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 21:10:44,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 21:10:44,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 21:10:44,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 21:10:44,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:44,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store-tmp 2023-07-17 21:10:44,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:44,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 21:10:44,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 21:10:44,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 21:10:44,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/WALs/jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:44,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33275%2C1689628242520, suffix=, logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/WALs/jenkins-hbase4.apache.org,33275,1689628242520, archiveDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/oldWALs, maxLogs=10 2023-07-17 21:10:44,899 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK] 2023-07-17 21:10:44,899 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK] 2023-07-17 21:10:44,896 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK] 2023-07-17 21:10:44,908 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 21:10:45,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/WALs/jenkins-hbase4.apache.org,33275,1689628242520/jenkins-hbase4.apache.org%2C33275%2C1689628242520.1689628244818 2023-07-17 21:10:45,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK], DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK]] 2023-07-17 21:10:45,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:45,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:45,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,120 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,127 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 21:10:45,161 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 21:10:45,175 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:45,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:45,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60916060, jitterRate=-0.09227997064590454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:45,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 21:10:45,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 21:10:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 21:10:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 21:10:45,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 21:10:45,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 21:10:45,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-07-17 21:10:45,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 21:10:45,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 21:10:45,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 21:10:45,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 21:10:45,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 21:10:45,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 21:10:45,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 21:10:45,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 21:10:45,373 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 21:10:45,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 21:10:45,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 21:10:45,402 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,402 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,402 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,402 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,402 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33275,1689628242520, sessionid=0x101751f716f0000, setting cluster-up flag (Was=false) 2023-07-17 21:10:45,425 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 21:10:45,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:45,441 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 21:10:45,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:45,452 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp 2023-07-17 21:10:45,492 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(951): ClusterId : eccd7c60-c16e-4a69-bc09-fcfc879b2a85 2023-07-17 21:10:45,500 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 21:10:45,508 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(951): ClusterId : eccd7c60-c16e-4a69-bc09-fcfc879b2a85 2023-07-17 21:10:45,500 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(951): ClusterId : eccd7c60-c16e-4a69-bc09-fcfc879b2a85 2023-07-17 21:10:45,510 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 21:10:45,509 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 21:10:45,518 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 21:10:45,518 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 21:10:45,519 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 21:10:45,519 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 21:10:45,519 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 21:10:45,519 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 21:10:45,527 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 21:10:45,527 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 21:10:45,530 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ReadOnlyZKClient(139): Connect 0x08a007c6 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:45,531 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 21:10:45,540 DEBUG [RS:1;jenkins-hbase4:39595] zookeeper.ReadOnlyZKClient(139): Connect 0x6d3ccca5 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:45,551 DEBUG [RS:0;jenkins-hbase4:46043] zookeeper.ReadOnlyZKClient(139): Connect 0x67ae90ba to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:45,581 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@667f8a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:45,582 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2586cb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:10:45,584 DEBUG [RS:1;jenkins-hbase4:39595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63fb3f72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:45,585 DEBUG [RS:1;jenkins-hbase4:39595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67c4a7d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:10:45,588 DEBUG [RS:0;jenkins-hbase4:46043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6969723f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:45,588 DEBUG [RS:0;jenkins-hbase4:46043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d56fbca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:10:45,622 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46043 2023-07-17 21:10:45,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 21:10:45,631 INFO [RS:0;jenkins-hbase4:46043] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 21:10:45,631 INFO [RS:0;jenkins-hbase4:46043] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 21:10:45,640 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44933 2023-07-17 21:10:45,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 21:10:45,638 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39595 2023-07-17 21:10:45,651 INFO [RS:1;jenkins-hbase4:39595] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 21:10:45,651 INFO [RS:1;jenkins-hbase4:39595] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 21:10:45,651 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 21:10:45,651 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 21:10:45,653 INFO [RS:1;jenkins-hbase4:39595] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,653 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 21:10:45,641 INFO [RS:2;jenkins-hbase4:44933] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 21:10:45,653 INFO [RS:2;jenkins-hbase4:44933] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 21:10:45,654 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 21:10:45,654 INFO [RS:2;jenkins-hbase4:44933] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,654 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 21:10:45,657 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33275,1689628242520 with isa=jenkins-hbase4.apache.org/172.31.14.131:39595, startcode=1689628244095 2023-07-17 21:10:45,657 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33275,1689628242520 with isa=jenkins-hbase4.apache.org/172.31.14.131:44933, startcode=1689628244150 2023-07-17 21:10:45,653 INFO [RS:0;jenkins-hbase4:46043] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,659 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 21:10:45,661 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33275,1689628242520 with isa=jenkins-hbase4.apache.org/172.31.14.131:46043, startcode=1689628244012 2023-07-17 21:10:45,689 DEBUG [RS:2;jenkins-hbase4:44933] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 21:10:45,689 DEBUG [RS:0;jenkins-hbase4:46043] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 21:10:45,689 DEBUG [RS:1;jenkins-hbase4:39595] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 21:10:45,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 21:10:45,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 21:10:45,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:45,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:45,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:45,802 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60767, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 21:10:45,802 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49067, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 21:10:45,802 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38105, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 21:10:45,830 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33275] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 21:10:45,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689628275838 2023-07-17 21:10:45,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 21:10:45,842 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33275] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 21:10:45,843 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 21:10:45,844 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 21:10:45,855 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33275] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 21:10:45,868 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:45,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 21:10:45,881 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 21:10:45,881 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 21:10:45,882 WARN [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 21:10:45,881 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 21:10:45,882 WARN [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 21:10:45,882 WARN [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 21:10:45,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 21:10:45,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 21:10:45,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 21:10:45,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 21:10:45,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 21:10:45,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 21:10:45,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 21:10:45,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 21:10:45,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 21:10:45,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689628245912,5,FailOnTimeoutGroup] 2023-07-17 21:10:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689628245914,5,FailOnTimeoutGroup] 2023-07-17 21:10:45,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 21:10:45,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,935 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:45,936 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:45,936 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:10:45,984 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33275,1689628242520 with isa=jenkins-hbase4.apache.org/172.31.14.131:46043, startcode=1689628244012 2023-07-17 21:10:45,984 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33275,1689628242520 with isa=jenkins-hbase4.apache.org/172.31.14.131:39595, startcode=1689628244095 2023-07-17 21:10:45,996 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33275,1689628242520 with isa=jenkins-hbase4.apache.org/172.31.14.131:44933, startcode=1689628244150 2023-07-17 21:10:45,999 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:46,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 21:10:46,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/info 2023-07-17 21:10:46,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 21:10:46,039 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33275] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,040 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 21:10:46,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/rep_barrier 2023-07-17 21:10:46,046 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 21:10:46,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,048 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 21:10:46,050 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33275] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,051 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:10:46,051 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34459 2023-07-17 21:10:46,051 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 21:10:46,059 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33275] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,059 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:10:46,059 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34459 2023-07-17 21:10:46,059 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 21:10:46,061 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:10:46,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/table 2023-07-17 21:10:46,064 DEBUG [RS:0;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,064 WARN [RS:0;jenkins-hbase4:46043] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:46,064 DEBUG [RS:1;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,065 INFO [RS:0;jenkins-hbase4:46043] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,065 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,067 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 21:10:46,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,065 WARN [RS:1;jenkins-hbase4:39595] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:46,078 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:10:46,080 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34459 2023-07-17 21:10:46,079 INFO [RS:1;jenkins-hbase4:39595] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,080 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,080 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 21:10:46,083 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46043,1689628244012] 2023-07-17 21:10:46,084 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39595,1689628244095] 2023-07-17 21:10:46,086 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:10:46,086 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,086 WARN [RS:2;jenkins-hbase4:44933] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:46,086 INFO [RS:2;jenkins-hbase4:44933] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,087 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,087 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44933,1689628244150] 2023-07-17 21:10:46,087 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740 2023-07-17 21:10:46,089 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740 2023-07-17 21:10:46,095 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 21:10:46,098 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 21:10:46,103 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,105 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,105 DEBUG [RS:0;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,106 DEBUG [RS:0;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,106 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,106 DEBUG [RS:0;jenkins-hbase4:46043] zookeeper.ZKUtil(162): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,109 DEBUG [RS:1;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,109 DEBUG [RS:1;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,110 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:46,111 DEBUG [RS:1;jenkins-hbase4:39595] zookeeper.ZKUtil(162): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,112 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63618586, jitterRate=-0.05200919508934021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 21:10:46,112 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 21:10:46,112 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 21:10:46,112 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 21:10:46,112 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 21:10:46,112 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 21:10:46,112 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 21:10:46,119 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 21:10:46,121 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 21:10:46,127 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 21:10:46,127 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 21:10:46,128 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 21:10:46,129 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 21:10:46,129 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 21:10:46,139 INFO [RS:1;jenkins-hbase4:39595] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 21:10:46,139 INFO [RS:2;jenkins-hbase4:44933] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 21:10:46,139 INFO [RS:0;jenkins-hbase4:46043] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 21:10:46,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 21:10:46,159 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 21:10:46,162 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 21:10:46,168 INFO [RS:0;jenkins-hbase4:46043] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 21:10:46,168 INFO [RS:2;jenkins-hbase4:44933] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 21:10:46,168 INFO [RS:1;jenkins-hbase4:39595] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 21:10:46,172 INFO [RS:0;jenkins-hbase4:46043] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 21:10:46,172 INFO [RS:2;jenkins-hbase4:44933] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 21:10:46,172 INFO [RS:1;jenkins-hbase4:39595] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 21:10:46,173 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,173 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,173 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,175 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 21:10:46,175 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 21:10:46,175 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 21:10:46,184 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,185 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,185 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,185 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,185 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,185 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,185 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:46,186 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,186 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,186 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,186 DEBUG [RS:1;jenkins-hbase4:39595] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,191 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,191 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,191 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,191 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,191 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,191 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,192 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:46,193 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:46,193 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,193 DEBUG [RS:0;jenkins-hbase4:46043] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,213 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,213 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,213 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,216 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,216 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,216 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,228 INFO [RS:1;jenkins-hbase4:39595] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 21:10:46,232 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39595,1689628244095-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,233 INFO [RS:2;jenkins-hbase4:44933] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 21:10:46,241 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44933,1689628244150-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,253 INFO [RS:0;jenkins-hbase4:46043] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 21:10:46,253 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46043,1689628244012-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,271 INFO [RS:1;jenkins-hbase4:39595] regionserver.Replication(203): jenkins-hbase4.apache.org,39595,1689628244095 started 2023-07-17 21:10:46,271 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39595,1689628244095, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39595, sessionid=0x101751f716f0002 2023-07-17 21:10:46,272 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 21:10:46,272 DEBUG [RS:1;jenkins-hbase4:39595] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,272 DEBUG [RS:1;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39595,1689628244095' 2023-07-17 21:10:46,272 DEBUG [RS:1;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 21:10:46,274 DEBUG [RS:1;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 21:10:46,275 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 21:10:46,276 INFO [RS:2;jenkins-hbase4:44933] regionserver.Replication(203): jenkins-hbase4.apache.org,44933,1689628244150 started 2023-07-17 21:10:46,276 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 21:10:46,276 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44933,1689628244150, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44933, sessionid=0x101751f716f0003 2023-07-17 21:10:46,276 DEBUG [RS:1;jenkins-hbase4:39595] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:46,276 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 21:10:46,276 DEBUG [RS:1;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39595,1689628244095' 2023-07-17 21:10:46,277 DEBUG [RS:2;jenkins-hbase4:44933] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,277 DEBUG [RS:1;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:46,278 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44933,1689628244150' 2023-07-17 21:10:46,289 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 21:10:46,290 INFO [RS:0;jenkins-hbase4:46043] regionserver.Replication(203): jenkins-hbase4.apache.org,46043,1689628244012 started 2023-07-17 21:10:46,290 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46043,1689628244012, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46043, sessionid=0x101751f716f0001 2023-07-17 21:10:46,290 DEBUG [RS:1;jenkins-hbase4:39595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:46,290 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 21:10:46,290 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 21:10:46,290 DEBUG [RS:0;jenkins-hbase4:46043] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,291 DEBUG [RS:0;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46043,1689628244012' 2023-07-17 21:10:46,291 DEBUG [RS:0;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 21:10:46,290 DEBUG [RS:1;jenkins-hbase4:39595] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 21:10:46,291 INFO [RS:1;jenkins-hbase4:39595] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 21:10:46,291 INFO [RS:1;jenkins-hbase4:39595] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 21:10:46,291 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 21:10:46,291 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 21:10:46,291 DEBUG [RS:2;jenkins-hbase4:44933] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:46,292 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44933,1689628244150' 2023-07-17 21:10:46,292 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:46,292 DEBUG [RS:0;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 21:10:46,292 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:46,293 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 21:10:46,294 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 21:10:46,294 DEBUG [RS:0;jenkins-hbase4:46043] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,294 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 21:10:46,294 DEBUG [RS:0;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46043,1689628244012' 2023-07-17 21:10:46,294 INFO [RS:2;jenkins-hbase4:44933] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 21:10:46,294 DEBUG [RS:0;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:46,294 INFO [RS:2;jenkins-hbase4:44933] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 21:10:46,296 DEBUG [RS:0;jenkins-hbase4:46043] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:46,296 DEBUG [RS:0;jenkins-hbase4:46043] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 21:10:46,296 INFO [RS:0;jenkins-hbase4:46043] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 21:10:46,296 INFO [RS:0;jenkins-hbase4:46043] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 21:10:46,314 DEBUG [jenkins-hbase4:33275] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 21:10:46,320 DEBUG [jenkins-hbase4:33275] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:46,329 DEBUG [jenkins-hbase4:33275] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:46,329 DEBUG [jenkins-hbase4:33275] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:46,329 DEBUG [jenkins-hbase4:33275] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:46,329 DEBUG [jenkins-hbase4:33275] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:46,332 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46043,1689628244012, state=OPENING 2023-07-17 21:10:46,341 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 21:10:46,342 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:46,343 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 21:10:46,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:10:46,404 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44933%2C1689628244150, suffix=, logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,44933,1689628244150, archiveDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs, maxLogs=32 2023-07-17 21:10:46,405 INFO [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46043%2C1689628244012, suffix=, logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,46043,1689628244012, archiveDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs, maxLogs=32 2023-07-17 21:10:46,407 INFO [RS:1;jenkins-hbase4:39595] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39595%2C1689628244095, suffix=, logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,39595,1689628244095, archiveDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs, maxLogs=32 2023-07-17 21:10:46,438 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK] 2023-07-17 21:10:46,439 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK] 2023-07-17 21:10:46,444 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK] 2023-07-17 21:10:46,461 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK] 2023-07-17 21:10:46,462 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK] 2023-07-17 21:10:46,467 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK] 2023-07-17 21:10:46,483 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK] 2023-07-17 21:10:46,483 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK] 2023-07-17 21:10:46,483 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK] 2023-07-17 21:10:46,489 INFO [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,46043,1689628244012/jenkins-hbase4.apache.org%2C46043%2C1689628244012.1689628246411 2023-07-17 21:10:46,489 DEBUG [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK], DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK], DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK]] 2023-07-17 21:10:46,496 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,44933,1689628244150/jenkins-hbase4.apache.org%2C44933%2C1689628244150.1689628246411 2023-07-17 21:10:46,496 INFO [RS:1;jenkins-hbase4:39595] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,39595,1689628244095/jenkins-hbase4.apache.org%2C39595%2C1689628244095.1689628246411 2023-07-17 21:10:46,498 DEBUG [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK], DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK]] 2023-07-17 21:10:46,507 DEBUG [RS:1;jenkins-hbase4:39595] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK], DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK]] 2023-07-17 21:10:46,551 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:46,554 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:10:46,557 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:10:46,572 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 21:10:46,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,577 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46043%2C1689628244012.meta, suffix=.meta, logDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,46043,1689628244012, archiveDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs, maxLogs=32 2023-07-17 21:10:46,598 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK] 2023-07-17 21:10:46,600 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK] 2023-07-17 21:10:46,600 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK] 2023-07-17 21:10:46,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,46043,1689628244012/jenkins-hbase4.apache.org%2C46043%2C1689628244012.meta.1689628246578.meta 2023-07-17 21:10:46,618 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42205,DS-12034e26-99d2-409d-8bdf-9f93685fcfb3,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-630c63bb-fdf3-496b-ac17-20065fb43978,DISK], DatanodeInfoWithStorage[127.0.0.1:40877,DS-041dafb5-fb26-4e6c-bca0-9479014300fd,DISK]] 2023-07-17 21:10:46,619 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:46,620 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 21:10:46,622 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:46,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 21:10:46,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 21:10:46,627 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 21:10:46,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 21:10:46,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:46,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 21:10:46,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 21:10:46,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 21:10:46,652 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/info 2023-07-17 21:10:46,652 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/info 2023-07-17 21:10:46,653 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 21:10:46,656 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,656 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 21:10:46,659 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/rep_barrier 2023-07-17 21:10:46,659 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/rep_barrier 2023-07-17 21:10:46,659 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 21:10:46,660 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,660 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 21:10:46,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/table 2023-07-17 21:10:46,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/table 2023-07-17 21:10:46,663 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 21:10:46,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740 2023-07-17 21:10:46,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740 2023-07-17 21:10:46,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 21:10:46,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 21:10:46,678 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68994352, jitterRate=0.02809596061706543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 21:10:46,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 21:10:46,698 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689628246542 2023-07-17 21:10:46,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 21:10:46,732 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46043,1689628244012, state=OPEN 2023-07-17 21:10:46,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 21:10:46,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 21:10:46,747 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 21:10:46,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 21:10:46,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46043,1689628244012 in 400 msec 2023-07-17 21:10:46,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 21:10:46,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 616 msec 2023-07-17 21:10:46,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1070 sec 2023-07-17 21:10:46,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689628246770, completionTime=-1 2023-07-17 21:10:46,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 21:10:46,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 21:10:46,843 DEBUG [hconnection-0x1915fb1c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:46,846 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:46,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 21:10:46,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689628306882 2023-07-17 21:10:46,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689628366882 2023-07-17 21:10:46,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-07-17 21:10:46,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33275,1689628242520-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33275,1689628242520-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33275,1689628242520-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33275, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,927 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 21:10:46,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 21:10:46,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:46,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 21:10:46,957 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:10:46,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:10:46,996 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,000 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772 empty. 2023-07-17 21:10:47,001 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,001 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 21:10:47,070 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:47,072 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e7a9537e59d7789054b7794bee20b772, NAME => 'hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:10:47,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:47,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e7a9537e59d7789054b7794bee20b772, disabling compactions & flushes 2023-07-17 21:10:47,108 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. after waiting 0 ms 2023-07-17 21:10:47,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,108 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e7a9537e59d7789054b7794bee20b772: 2023-07-17 21:10:47,112 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:10:47,135 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689628247115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628247115"}]},"ts":"1689628247115"} 2023-07-17 21:10:47,173 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 21:10:47,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:10:47,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628247176"}]},"ts":"1689628247176"} 2023-07-17 21:10:47,184 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 21:10:47,188 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:47,191 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:47,191 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:47,191 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:47,191 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:47,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e7a9537e59d7789054b7794bee20b772, ASSIGN}] 2023-07-17 21:10:47,197 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e7a9537e59d7789054b7794bee20b772, ASSIGN 2023-07-17 21:10:47,202 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e7a9537e59d7789054b7794bee20b772, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1689628244095; forceNewPlan=false, retain=false 2023-07-17 21:10:47,355 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 21:10:47,356 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e7a9537e59d7789054b7794bee20b772, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:47,356 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689628247356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628247356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628247356"}]},"ts":"1689628247356"} 2023-07-17 21:10:47,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e7a9537e59d7789054b7794bee20b772, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:10:47,521 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:47,522 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:10:47,526 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:10:47,534 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7a9537e59d7789054b7794bee20b772, NAME => 'hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:47,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. service=AccessControlService 2023-07-17 21:10:47,535 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:47,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:47,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,539 INFO [StoreOpener-e7a9537e59d7789054b7794bee20b772-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,541 DEBUG [StoreOpener-e7a9537e59d7789054b7794bee20b772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/info 2023-07-17 21:10:47,541 DEBUG [StoreOpener-e7a9537e59d7789054b7794bee20b772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/info 2023-07-17 21:10:47,542 INFO [StoreOpener-e7a9537e59d7789054b7794bee20b772-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7a9537e59d7789054b7794bee20b772 columnFamilyName info 2023-07-17 21:10:47,543 INFO [StoreOpener-e7a9537e59d7789054b7794bee20b772-1] regionserver.HStore(310): Store=e7a9537e59d7789054b7794bee20b772/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:47,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7a9537e59d7789054b7794bee20b772 2023-07-17 21:10:47,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:47,556 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7a9537e59d7789054b7794bee20b772; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65570383, jitterRate=-0.022925153374671936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:47,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7a9537e59d7789054b7794bee20b772: 2023-07-17 21:10:47,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772., pid=6, masterSystemTime=1689628247521 2023-07-17 21:10:47,563 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,563 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:10:47,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e7a9537e59d7789054b7794bee20b772, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:47,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689628247564"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628247564"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628247564"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628247564"}]},"ts":"1689628247564"} 2023-07-17 21:10:47,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 21:10:47,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e7a9537e59d7789054b7794bee20b772, server=jenkins-hbase4.apache.org,39595,1689628244095 in 202 msec 2023-07-17 21:10:47,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 21:10:47,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e7a9537e59d7789054b7794bee20b772, ASSIGN in 378 msec 2023-07-17 21:10:47,577 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:10:47,578 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628247578"}]},"ts":"1689628247578"} 2023-07-17 21:10:47,580 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 21:10:47,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:10:47,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 643 msec 2023-07-17 21:10:47,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 21:10:47,659 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 21:10:47,659 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:47,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:47,697 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:47,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 21:10:47,735 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 21:10:47,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-07-17 21:10:47,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 21:10:47,770 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 21:10:47,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-17 21:10:47,781 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 21:10:47,784 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 21:10:47,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.541sec 2023-07-17 21:10:47,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 21:10:47,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 21:10:47,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 21:10:47,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33275,1689628242520-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 21:10:47,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33275,1689628242520-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 21:10:47,798 DEBUG [Listener at localhost/39161] zookeeper.ReadOnlyZKClient(139): Connect 0x0aad9b51 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:47,806 DEBUG [Listener at localhost/39161] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ed5619, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:47,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:47,825 DEBUG [hconnection-0x40158772-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:47,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 21:10:47,828 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:10:47,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:10:47,834 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:47,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 21:10:47,835 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09 empty. 2023-07-17 21:10:47,838 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:47,838 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 21:10:47,841 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:47,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/test.cache.data in system properties and HBase conf 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop.log.dir in system properties and HBase conf 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 21:10:47,846 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 21:10:47,847 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:47,847 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/nfs.dump.dir in system properties and HBase conf 2023-07-17 21:10:47,848 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir in system properties and HBase conf 2023-07-17 21:10:47,849 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:47,849 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 21:10:47,849 INFO [Listener at localhost/39161] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 21:10:47,898 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:47,901 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc48b3885348eb9bc727ef7b11b94a09, NAME => 'hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:10:47,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:47,966 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:47,967 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing dc48b3885348eb9bc727ef7b11b94a09, disabling compactions & flushes 2023-07-17 21:10:47,967 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:47,967 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:47,967 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. after waiting 0 ms 2023-07-17 21:10:47,967 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:47,967 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:47,967 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for dc48b3885348eb9bc727ef7b11b94a09: 2023-07-17 21:10:47,974 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:10:47,976 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689628247976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628247976"}]},"ts":"1689628247976"} 2023-07-17 21:10:47,981 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 21:10:47,983 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:10:47,983 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628247983"}]},"ts":"1689628247983"} 2023-07-17 21:10:47,989 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 21:10:47,996 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:47,999 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:47,999 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:47,999 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:47,999 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:48,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dc48b3885348eb9bc727ef7b11b94a09, ASSIGN}] 2023-07-17 21:10:48,007 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dc48b3885348eb9bc727ef7b11b94a09, ASSIGN 2023-07-17 21:10:48,013 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=dc48b3885348eb9bc727ef7b11b94a09, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689628244012; forceNewPlan=false, retain=false 2023-07-17 21:10:48,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:48,165 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 21:10:48,166 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dc48b3885348eb9bc727ef7b11b94a09, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:48,167 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689628248166"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628248166"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628248166"}]},"ts":"1689628248166"} 2023-07-17 21:10:48,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure dc48b3885348eb9bc727ef7b11b94a09, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:10:48,345 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:48,345 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc48b3885348eb9bc727ef7b11b94a09, NAME => 'hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:48,346 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. service=AccessControlService 2023-07-17 21:10:48,346 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:48,346 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:48,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,356 INFO [StoreOpener-dc48b3885348eb9bc727ef7b11b94a09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,362 DEBUG [StoreOpener-dc48b3885348eb9bc727ef7b11b94a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/l 2023-07-17 21:10:48,363 DEBUG [StoreOpener-dc48b3885348eb9bc727ef7b11b94a09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/l 2023-07-17 21:10:48,363 INFO [StoreOpener-dc48b3885348eb9bc727ef7b11b94a09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc48b3885348eb9bc727ef7b11b94a09 columnFamilyName l 2023-07-17 21:10:48,365 INFO [StoreOpener-dc48b3885348eb9bc727ef7b11b94a09-1] regionserver.HStore(310): Store=dc48b3885348eb9bc727ef7b11b94a09/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:48,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,386 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:10:48,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:48,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc48b3885348eb9bc727ef7b11b94a09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69303025, jitterRate=0.03269554674625397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:48,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc48b3885348eb9bc727ef7b11b94a09: 2023-07-17 21:10:48,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09., pid=11, masterSystemTime=1689628248327 2023-07-17 21:10:48,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:48,408 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:10:48,411 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dc48b3885348eb9bc727ef7b11b94a09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:48,411 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689628248411"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628248411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628248411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628248411"}]},"ts":"1689628248411"} 2023-07-17 21:10:48,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 21:10:48,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure dc48b3885348eb9bc727ef7b11b94a09, server=jenkins-hbase4.apache.org,46043,1689628244012 in 244 msec 2023-07-17 21:10:48,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 21:10:48,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=dc48b3885348eb9bc727ef7b11b94a09, ASSIGN in 422 msec 2023-07-17 21:10:48,427 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:10:48,428 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628248427"}]},"ts":"1689628248427"} 2023-07-17 21:10:48,430 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 21:10:48,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:10:48,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 620 msec 2023-07-17 21:10:48,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:48,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 21:10:48,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 21:10:49,416 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:49,824 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:49,831 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38021_jobhistory____ej89eb/webapp 2023-07-17 21:10:50,032 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 21:10:50,032 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:50,032 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:50,036 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:50,125 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:50,460 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:50,934 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 21:10:51,003 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38021 2023-07-17 21:10:52,205 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:10:52,514 WARN [Listener at jenkins-hbase4.apache.org/37247] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:52,565 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 21:10:52,567 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 21:10:52,568 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 21:10:52,631 WARN [Listener at jenkins-hbase4.apache.org/37247] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 21:10:52,632 INFO [Listener at jenkins-hbase4.apache.org/37247] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:52,645 INFO [Listener at jenkins-hbase4.apache.org/37247] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39079_cluster____.s6479k/webapp 2023-07-17 21:10:52,717 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:10:52,718 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 21:10:52,718 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:10:52,719 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 21:10:52,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 21:10:52,719 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 21:10:52,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:10:52,719 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 21:10:52,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 21:10:52,719 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 21:10:52,727 INFO [Listener at jenkins-hbase4.apache.org/37247] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:52,727 INFO [Listener at jenkins-hbase4.apache.org/37247] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 21:10:52,727 INFO [Listener at jenkins-hbase4.apache.org/37247] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:52,728 INFO [Listener at jenkins-hbase4.apache.org/37247] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:52,738 INFO [Listener at jenkins-hbase4.apache.org/37247] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:52,952 INFO [Listener at jenkins-hbase4.apache.org/37247] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,137 INFO [Listener at jenkins-hbase4.apache.org/37247] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,150 INFO [Listener at jenkins-hbase4.apache.org/37247] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39079 2023-07-17 21:10:53,647 WARN [Listener at jenkins-hbase4.apache.org/36405] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:53,673 WARN [Listener at jenkins-hbase4.apache.org/36405] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 21:10:53,674 INFO [Listener at jenkins-hbase4.apache.org/36405] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:53,684 INFO [Listener at jenkins-hbase4.apache.org/36405] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37527_node____.dkhv8s/webapp 2023-07-17 21:10:53,748 INFO [Listener at jenkins-hbase4.apache.org/36405] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 21:10:53,749 INFO [Listener at jenkins-hbase4.apache.org/36405] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:53,749 INFO [Listener at jenkins-hbase4.apache.org/36405] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:53,749 INFO [Listener at jenkins-hbase4.apache.org/36405] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:53,757 INFO [Listener at jenkins-hbase4.apache.org/36405] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,783 INFO [Listener at jenkins-hbase4.apache.org/36405] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,887 INFO [Listener at jenkins-hbase4.apache.org/36405] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,923 INFO [Listener at jenkins-hbase4.apache.org/36405] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37527 2023-07-17 21:10:54,202 WARN [Listener at jenkins-hbase4.apache.org/43825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:54,211 WARN [Listener at jenkins-hbase4.apache.org/43825] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 21:10:54,212 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:54,222 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41859_node____n68upp/webapp 2023-07-17 21:10:54,299 INFO [Listener at jenkins-hbase4.apache.org/43825] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 21:10:54,299 INFO [Listener at jenkins-hbase4.apache.org/43825] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:54,299 INFO [Listener at jenkins-hbase4.apache.org/43825] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:54,300 INFO [Listener at jenkins-hbase4.apache.org/43825] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:54,312 INFO [Listener at jenkins-hbase4.apache.org/43825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:54,335 INFO [Listener at jenkins-hbase4.apache.org/43825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:54,442 INFO [Listener at jenkins-hbase4.apache.org/43825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:54,459 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41859 2023-07-17 21:10:54,493 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 21:10:54,495 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:54,564 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=179, AvailableMemoryMB=4862 2023-07-17 21:10:54,564 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-17 21:10:54,581 DEBUG [Listener at jenkins-hbase4.apache.org/43825] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 21:10:54,594 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 21:10:54,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 21:10:54,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:10:54,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:10:54,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 21:10:54,613 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:10:54,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:54,621 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:54,622 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:54,622 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad empty. 2023-07-17 21:10:54,623 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:54,625 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 empty. 2023-07-17 21:10:54,626 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:54,627 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 21:10:54,672 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:54,674 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 200b78b351d04ee2074cfe5598a196f0, NAME => 'testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:10:54,674 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5fcdcce502d5005f91812108f90241ad, NAME => 'testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:10:54,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:54,706 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 200b78b351d04ee2074cfe5598a196f0, disabling compactions & flushes 2023-07-17 21:10:54,706 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:54,706 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:54,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. after waiting 0 ms 2023-07-17 21:10:54,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:54,707 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:54,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 200b78b351d04ee2074cfe5598a196f0: 2023-07-17 21:10:54,709 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:54,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5fcdcce502d5005f91812108f90241ad, disabling compactions & flushes 2023-07-17 21:10:54,710 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:54,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:54,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. after waiting 0 ms 2023-07-17 21:10:54,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:54,710 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:54,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5fcdcce502d5005f91812108f90241ad: 2023-07-17 21:10:54,714 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:10:54,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:54,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628254715"}]},"ts":"1689628254715"} 2023-07-17 21:10:54,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628254715"}]},"ts":"1689628254715"} 2023-07-17 21:10:54,777 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:10:54,779 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:10:54,780 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628254779"}]},"ts":"1689628254779"} 2023-07-17 21:10:54,782 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 21:10:54,787 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:54,789 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:54,789 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:54,789 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:54,789 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:54,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, ASSIGN}] 2023-07-17 21:10:54,793 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, ASSIGN 2023-07-17 21:10:54,794 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, ASSIGN 2023-07-17 21:10:54,796 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689628244012; forceNewPlan=false, retain=false 2023-07-17 21:10:54,796 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1689628244150; forceNewPlan=false, retain=false 2023-07-17 21:10:54,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:54,947 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:10:54,949 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=200b78b351d04ee2074cfe5598a196f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:54,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5fcdcce502d5005f91812108f90241ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:54,950 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628254949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628254949"}]},"ts":"1689628254949"} 2023-07-17 21:10:54,950 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628254949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628254949"}]},"ts":"1689628254949"} 2023-07-17 21:10:54,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 200b78b351d04ee2074cfe5598a196f0, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:10:54,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5fcdcce502d5005f91812108f90241ad, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:10:55,108 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,108 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:10:55,110 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:10:55,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:55,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:55,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 200b78b351d04ee2074cfe5598a196f0, NAME => 'testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:10:55,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5fcdcce502d5005f91812108f90241ad, NAME => 'testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:10:55,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. service=AccessControlService 2023-07-17 21:10:55,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. service=AccessControlService 2023-07-17 21:10:55,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:55,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,120 INFO [StoreOpener-5fcdcce502d5005f91812108f90241ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,120 INFO [StoreOpener-200b78b351d04ee2074cfe5598a196f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,123 DEBUG [StoreOpener-200b78b351d04ee2074cfe5598a196f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf 2023-07-17 21:10:55,123 DEBUG [StoreOpener-200b78b351d04ee2074cfe5598a196f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf 2023-07-17 21:10:55,123 DEBUG [StoreOpener-5fcdcce502d5005f91812108f90241ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf 2023-07-17 21:10:55,123 DEBUG [StoreOpener-5fcdcce502d5005f91812108f90241ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf 2023-07-17 21:10:55,129 INFO [StoreOpener-5fcdcce502d5005f91812108f90241ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fcdcce502d5005f91812108f90241ad columnFamilyName cf 2023-07-17 21:10:55,130 INFO [StoreOpener-200b78b351d04ee2074cfe5598a196f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 200b78b351d04ee2074cfe5598a196f0 columnFamilyName cf 2023-07-17 21:10:55,136 INFO [StoreOpener-5fcdcce502d5005f91812108f90241ad-1] regionserver.HStore(310): Store=5fcdcce502d5005f91812108f90241ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:55,136 INFO [StoreOpener-200b78b351d04ee2074cfe5598a196f0-1] regionserver.HStore(310): Store=200b78b351d04ee2074cfe5598a196f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:55,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:10:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:10:55,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:55,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5fcdcce502d5005f91812108f90241ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72445294, jitterRate=0.07951900362968445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:55,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5fcdcce502d5005f91812108f90241ad: 2023-07-17 21:10:55,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad., pid=16, masterSystemTime=1689628255108 2023-07-17 21:10:55,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:55,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:55,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:55,178 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5fcdcce502d5005f91812108f90241ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,178 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628255177"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628255177"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628255177"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628255177"}]},"ts":"1689628255177"} 2023-07-17 21:10:55,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 200b78b351d04ee2074cfe5598a196f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74930877, jitterRate=0.11655707657337189}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 200b78b351d04ee2074cfe5598a196f0: 2023-07-17 21:10:55,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0., pid=15, masterSystemTime=1689628255108 2023-07-17 21:10:55,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:55,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:55,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=200b78b351d04ee2074cfe5598a196f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,211 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628255210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628255210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628255210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628255210"}]},"ts":"1689628255210"} 2023-07-17 21:10:55,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-17 21:10:55,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5fcdcce502d5005f91812108f90241ad, server=jenkins-hbase4.apache.org,46043,1689628244012 in 247 msec 2023-07-17 21:10:55,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, ASSIGN in 423 msec 2023-07-17 21:10:55,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-17 21:10:55,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 200b78b351d04ee2074cfe5598a196f0, server=jenkins-hbase4.apache.org,44933,1689628244150 in 262 msec 2023-07-17 21:10:55,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:55,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-17 21:10:55,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, ASSIGN in 430 msec 2023-07-17 21:10:55,225 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:10:55,225 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628255225"}]},"ts":"1689628255225"} 2023-07-17 21:10:55,227 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 21:10:55,232 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:10:55,239 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 21:10:55,273 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 21:10:55,307 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,307 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,307 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,307 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:55,307 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 713 msec 2023-07-17 21:10:55,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:55,723 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 21:10:55,728 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 21:10:55,729 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:55,732 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:55,769 DEBUG [hconnection-0x40158772-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,775 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:55,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628255789 (current time:1689628255789). 2023-07-17 21:10:55,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:10:55,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x1169ee16 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7654adf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:55,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,800 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1169ee16 to 127.0.0.1:60809 2023-07-17 21:10:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:55,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x3daf4db1 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:55,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59d03f06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:55,815 DEBUG [hconnection-0x69df6c27-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,817 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3daf4db1 to 127.0.0.1:60809 2023-07-17 21:10:55,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:55,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 21:10:55,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:10:55,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:55,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:55,878 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:55,881 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689628855880 2023-07-17 21:10:55,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:55,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 21:10:55,884 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:55,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:55,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-17 21:10:55,890 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:55,891 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:10:55,891 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:10:55,891 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689628855891 2023-07-17 21:10:55,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,918 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 21:10:55,918 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,919 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 21:10:55,919 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 21:10:55,920 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,920 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,924 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:55,924 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:55,924 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:55,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:55,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:55,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:55,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:55,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:55,925 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:55,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,926 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,926 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,927 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,927 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:10:55,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 21:10:55,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 21:10:55,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:55,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:55,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 21:10:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,930 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:55,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,934 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:55,934 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,935 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:55,935 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:55,935 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:55,948 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:55,948 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:55,948 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,948 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:55,950 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:55,950 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:55,950 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:55,950 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,950 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:55,950 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:55,950 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:55,952 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,954 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,954 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 1] remaining members to acquire global barrier 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:55,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:55,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 0] remaining members to acquire global barrier 2023-07-17 21:10:55,958 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 21:10:55,958 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:10:55,962 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:55,962 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:55,962 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:55,963 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:55,963 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:55,963 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:10:55,963 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. started... 2023-07-17 21:10:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:55,968 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:55,968 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:55,968 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. started... 2023-07-17 21:10:55,968 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:55,968 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:55,970 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 200b78b351d04ee2074cfe5598a196f0: 2023-07-17 21:10:55,971 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5fcdcce502d5005f91812108f90241ad: 2023-07-17 21:10:55,972 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,972 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,980 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:55,980 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:55,985 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:10:55,985 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:10:55,991 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:55,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:55,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:56,006 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:10:56,039 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. completed. 2023-07-17 21:10:56,039 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:56,040 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:56,040 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:56,040 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,040 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:56,040 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:10:56,046 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,053 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:56,053 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,053 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:10:56,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 21:10:56,207 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:56,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:56,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:56,208 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:10:56,441 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. completed. 2023-07-17 21:10:56,441 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:56,441 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:56,441 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:56,441 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,441 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:56,441 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:10:56,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,443 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:56,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,443 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,444 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:10:56,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 21:10:56,450 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 21:10:56,450 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:10:56,450 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:10:56,450 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,450 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:10:56,453 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,453 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,454 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,454 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,455 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,456 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,462 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,464 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,464 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,488 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,488 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,488 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,488 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,488 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,489 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,489 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,489 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,490 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,490 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,490 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,490 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:56,490 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,490 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,491 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:56,492 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:56,492 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,492 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,492 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-17 21:10:56,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:10:56,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-17 21:10:56,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 21:10:56,509 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:56,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:56,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:56,514 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 21:10:56,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 21:10:56,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,622 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689628255882Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689628256516 (+634 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689628256516Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689628256516Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689628256532 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689628256561 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689628256621 (+60 ms) 2023-07-17 21:10:56,624 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:56,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 740 msec 2023-07-17 21:10:57,014 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:57,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:57,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:10:57,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:10:57,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:10:57,036 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 21:10:57,036 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:57,036 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:57,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:57,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628257050 (current time:1689628257050). 2023-07-17 21:10:57,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:10:57,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x2c07d81b to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:57,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e9f4d2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:57,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:57,059 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:57,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c07d81b to 127.0.0.1:60809 2023-07-17 21:10:57,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:57,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x54279541 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:57,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f248de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:57,068 DEBUG [hconnection-0x52909b13-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:57,070 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:57,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54279541 to 127.0.0.1:60809 2023-07-17 21:10:57,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:57,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 21:10:57,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:10:57,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:57,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:57,080 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:57,081 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689628857081 2023-07-17 21:10:57,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 21:10:57,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:57,082 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:10:57,082 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:10:57,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:57,083 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:57,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-07-17 21:10:57,085 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:57,086 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689628857086 2023-07-17 21:10:57,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 21:10:57,106 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 21:10:57,106 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:57,107 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 21:10:57,107 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 21:10:57,108 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,108 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,109 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:57,109 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:57,109 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:57,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:57,109 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:57,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:57,110 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,110 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,111 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,111 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:57,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:57,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 21:10:57,112 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:57,112 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:57,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 21:10:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:57,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 21:10:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:57,116 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:57,117 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:57,117 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:57,117 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:57,119 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,120 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,120 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:57,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:57,122 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,122 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,122 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,122 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:57,122 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:57,122 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:57,123 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,123 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:57,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:57,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 1] remaining members to acquire global barrier 2023-07-17 21:10:57,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:57,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:57,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:57,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:57,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:57,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:57,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 0] remaining members to acquire global barrier 2023-07-17 21:10:57,129 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 21:10:57,129 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,134 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:57,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,135 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:57,135 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:57,135 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,135 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:10:57,135 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:57,135 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. started... 2023-07-17 21:10:57,135 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:57,136 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:57,135 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. started... 2023-07-17 21:10:57,136 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5fcdcce502d5005f91812108f90241ad 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-17 21:10:57,136 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 200b78b351d04ee2074cfe5598a196f0 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-17 21:10:57,138 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:57,138 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:57,138 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:57,182 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:57,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:57,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:57,184 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:10:57,281 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071736da8ac8d2654497a013d7993f482bc6 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071736da8ac8d2654497a013d7993f482bc6 2023-07-17 21:10:57,281 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071756504632d90e4bcb874611e42966c6d3 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071756504632d90e4bcb874611e42966c6d3 2023-07-17 21:10:57,324 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/.tmp/cf/c96af97d91dd4bd7aeb98ddeda14f879 2023-07-17 21:10:57,328 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/.tmp/cf/1019d82c7c984cef928129e8942a70ed 2023-07-17 21:10:57,341 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/.tmp/cf/1019d82c7c984cef928129e8942a70ed as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf/1019d82c7c984cef928129e8942a70ed 2023-07-17 21:10:57,341 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/.tmp/cf/c96af97d91dd4bd7aeb98ddeda14f879 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf/c96af97d91dd4bd7aeb98ddeda14f879 2023-07-17 21:10:57,354 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf/1019d82c7c984cef928129e8942a70ed, entries=45, sequenceid=6, filesize=12.5 K 2023-07-17 21:10:57,358 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 200b78b351d04ee2074cfe5598a196f0 in 222ms, sequenceid=6, compaction requested=false 2023-07-17 21:10:57,358 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 21:10:57,360 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 200b78b351d04ee2074cfe5598a196f0: 2023-07-17 21:10:57,360 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:57,360 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:57,361 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf/1019d82c7c984cef928129e8942a70ed] hfiles 2023-07-17 21:10:57,361 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf/1019d82c7c984cef928129e8942a70ed for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:57,363 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf/c96af97d91dd4bd7aeb98ddeda14f879, entries=5, sequenceid=6, filesize=5.7 K 2023-07-17 21:10:57,367 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5fcdcce502d5005f91812108f90241ad in 231ms, sequenceid=6, compaction requested=false 2023-07-17 21:10:57,369 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5fcdcce502d5005f91812108f90241ad: 2023-07-17 21:10:57,370 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:57,370 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:57,370 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf/c96af97d91dd4bd7aeb98ddeda14f879] hfiles 2023-07-17 21:10:57,370 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf/c96af97d91dd4bd7aeb98ddeda14f879 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:57,387 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:57,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:57,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:57,391 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:10:57,424 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. completed. 2023-07-17 21:10:57,424 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:10:57,424 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:57,424 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:57,424 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,424 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:57,424 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:10:57,426 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,431 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. completed. 2023-07-17 21:10:57,432 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:10:57,432 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:57,432 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:57,432 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,432 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:57,432 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:10:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:10:57,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 21:10:57,434 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,434 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:57,434 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:57,434 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:10:57,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 21:10:57,439 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 21:10:57,439 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:10:57,439 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:10:57,439 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 21:10:57,439 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:57,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,442 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:57,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:57,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:57,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:57,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:57,450 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,450 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:57,451 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:57,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:57,453 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,454 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,454 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:57,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:57,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 21:10:57,465 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:57,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:57,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:57,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:57,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-17 21:10:57,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:57,465 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:57,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:57,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:10:57,466 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:10:57,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:57,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071756504632d90e4bcb874611e42966c6d3, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071736da8ac8d2654497a013d7993f482bc6] mob files 2023-07-17 21:10:57,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071756504632d90e4bcb874611e42966c6d3 2023-07-17 21:10:57,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071736da8ac8d2654497a013d7993f482bc6 2023-07-17 21:10:57,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 21:10:57,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 21:10:57,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 21:10:57,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689628257081Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689628257486 (+405 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689628257486Loading Region manifests for snaptb0-testExportWithTargetName at 1689628257486Writing data manifest for snaptb0-testExportWithTargetName at 1689628257492 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689628257521 (+29 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689628257576 (+55 ms) 2023-07-17 21:10:57,579 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:57,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 499 msec 2023-07-17 21:10:57,691 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:57,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:57,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:10:57,695 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695 2023-07-17 21:10:57,696 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34459, tgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695, rawTgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:10:57,752 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:10:57,752 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1563332967_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 21:10:57,752 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 21:10:57,777 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 21:10:57,869 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:57,869 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:57,870 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:57,870 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,897 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-5096705911081186191.jar 2023-07-17 21:10:58,897 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,898 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,982 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-6075152555064079600.jar 2023-07-17 21:10:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,984 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,984 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,985 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,985 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,986 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,986 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:10:58,987 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:10:58,988 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:10:58,988 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:10:58,989 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:10:58,989 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:10:58,990 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:10:58,990 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:10:58,990 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:10:58,991 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:10:58,995 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,995 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,996 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:10:58,996 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,996 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,997 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:10:58,997 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:00,083 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:00,089 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 21:11:00,098 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-17 21:11:00,635 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:11:00,673 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:00,673 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:01,303 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:06,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:09,067 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:12,318 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:14,120 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:11:14,122 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:11:14,133 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 21:11:14,133 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:11:14,134 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:11:14,134 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 21:11:14,134 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 21:11:14,135 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 21:11:14,135 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695/.hbase-snapshot/testExportWithTargetName 2023-07-17 21:11:14,135 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 21:11:14,135 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628257695/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 21:11:14,145 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 21:11:14,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 21:11:14,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,176 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628274175"}]},"ts":"1689628274175"} 2023-07-17 21:11:14,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,178 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 21:11:14,188 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 21:11:14,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, UNASSIGN}] 2023-07-17 21:11:14,193 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, UNASSIGN 2023-07-17 21:11:14,193 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, UNASSIGN 2023-07-17 21:11:14,194 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5fcdcce502d5005f91812108f90241ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:14,194 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=200b78b351d04ee2074cfe5598a196f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:14,194 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274194"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628274194"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628274194"}]},"ts":"1689628274194"} 2023-07-17 21:11:14,194 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274194"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628274194"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628274194"}]},"ts":"1689628274194"} 2023-07-17 21:11:14,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5fcdcce502d5005f91812108f90241ad, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:11:14,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 200b78b351d04ee2074cfe5598a196f0, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:11:14,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:11:14,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:11:14,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 200b78b351d04ee2074cfe5598a196f0, disabling compactions & flushes 2023-07-17 21:11:14,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5fcdcce502d5005f91812108f90241ad, disabling compactions & flushes 2023-07-17 21:11:14,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:11:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:11:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. after waiting 0 ms 2023-07-17 21:11:14,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:11:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:11:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:11:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. after waiting 0 ms 2023-07-17 21:11:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:11:14,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:14,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:14,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:14,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:14,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad. 2023-07-17 21:11:14,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0. 2023-07-17 21:11:14,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5fcdcce502d5005f91812108f90241ad: 2023-07-17 21:11:14,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 200b78b351d04ee2074cfe5598a196f0: 2023-07-17 21:11:14,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5fcdcce502d5005f91812108f90241ad 2023-07-17 21:11:14,377 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5fcdcce502d5005f91812108f90241ad, regionState=CLOSED 2023-07-17 21:11:14,378 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274377"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628274377"}]},"ts":"1689628274377"} 2023-07-17 21:11:14,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:11:14,378 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=200b78b351d04ee2074cfe5598a196f0, regionState=CLOSED 2023-07-17 21:11:14,379 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628274378"}]},"ts":"1689628274378"} 2023-07-17 21:11:14,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-17 21:11:14,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5fcdcce502d5005f91812108f90241ad, server=jenkins-hbase4.apache.org,46043,1689628244012 in 186 msec 2023-07-17 21:11:14,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-17 21:11:14,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 200b78b351d04ee2074cfe5598a196f0, server=jenkins-hbase4.apache.org,44933,1689628244150 in 186 msec 2023-07-17 21:11:14,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5fcdcce502d5005f91812108f90241ad, UNASSIGN in 195 msec 2023-07-17 21:11:14,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-17 21:11:14,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=200b78b351d04ee2074cfe5598a196f0, UNASSIGN in 196 msec 2023-07-17 21:11:14,389 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628274389"}]},"ts":"1689628274389"} 2023-07-17 21:11:14,390 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 21:11:14,451 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 21:11:14,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 299 msec 2023-07-17 21:11:14,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,479 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 21:11:14,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 21:11:14,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,494 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 21:11:14,496 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,499 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 21:11:14,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad 2023-07-17 21:11:14,502 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:11:14,506 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/recovered.edits] 2023-07-17 21:11:14,506 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/recovered.edits] 2023-07-17 21:11:14,515 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf/1019d82c7c984cef928129e8942a70ed to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/cf/1019d82c7c984cef928129e8942a70ed 2023-07-17 21:11:14,515 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf/c96af97d91dd4bd7aeb98ddeda14f879 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/cf/c96af97d91dd4bd7aeb98ddeda14f879 2023-07-17 21:11:14,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad/recovered.edits/9.seqid 2023-07-17 21:11:14,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0/recovered.edits/9.seqid 2023-07-17 21:11:14,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/5fcdcce502d5005f91812108f90241ad 2023-07-17 21:11:14,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportWithTargetName/200b78b351d04ee2074cfe5598a196f0 2023-07-17 21:11:14,521 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 21:11:14,521 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-17 21:11:14,522 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-17 21:11:14,527 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071756504632d90e4bcb874611e42966c6d3 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071756504632d90e4bcb874611e42966c6d3 2023-07-17 21:11:14,528 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071736da8ac8d2654497a013d7993f482bc6 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071736da8ac8d2654497a013d7993f482bc6 2023-07-17 21:11:14,529 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-17 21:11:14,532 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,553 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 21:11:14,573 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,573 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,573 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,573 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 21:11:14,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 21:11:14,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628274579"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:14,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628274579"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:14,582 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:11:14,582 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5fcdcce502d5005f91812108f90241ad, NAME => 'testtb-testExportWithTargetName,,1689628254602.5fcdcce502d5005f91812108f90241ad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 200b78b351d04ee2074cfe5598a196f0, NAME => 'testtb-testExportWithTargetName,1,1689628254602.200b78b351d04ee2074cfe5598a196f0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:11:14,582 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 21:11:14,582 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628274582"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:14,584 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 21:11:14,612 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,612 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 21:11:14,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 21:11:14,612 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:14,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 21:11:14,612 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:14,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 21:11:14,612 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,612 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,612 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:14,612 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:14,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 21:11:14,659 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 174 msec 2023-07-17 21:11:14,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 21:11:14,717 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 21:11:14,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 21:11:14,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 21:11:14,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 21:11:14,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 21:11:14,777 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 708) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:35551 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:43639 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:46748 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421958200_1 at /127.0.0.1:46726 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:54376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1314 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:43026 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 254) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=3121 (was 4862) 2023-07-17 21:11:14,777 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-17 21:11:14,801 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=183, AvailableMemoryMB=3120 2023-07-17 21:11:14,801 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-17 21:11:14,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 21:11:14,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:14,808 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:11:14,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 21:11:14,810 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:11:14,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:14,813 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:14,813 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:14,814 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 empty. 2023-07-17 21:11:14,814 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 empty. 2023-07-17 21:11:14,815 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:14,815 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:14,815 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 21:11:14,836 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 21:11:14,837 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c417a17750b594afc3686fb4b64072c8, NAME => 'testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:11:14,837 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0ba6a173d12de8db664f3a904fc0fa16, NAME => 'testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:11:14,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:14,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c417a17750b594afc3686fb4b64072c8, disabling compactions & flushes 2023-07-17 21:11:14,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:14,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:14,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. after waiting 0 ms 2023-07-17 21:11:14,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:14,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:14,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c417a17750b594afc3686fb4b64072c8: 2023-07-17 21:11:14,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:14,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0ba6a173d12de8db664f3a904fc0fa16, disabling compactions & flushes 2023-07-17 21:11:14,868 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:14,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:14,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. after waiting 0 ms 2023-07-17 21:11:14,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:14,868 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:14,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0ba6a173d12de8db664f3a904fc0fa16: 2023-07-17 21:11:14,871 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:11:14,872 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628274872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628274872"}]},"ts":"1689628274872"} 2023-07-17 21:11:14,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628274872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628274872"}]},"ts":"1689628274872"} 2023-07-17 21:11:14,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:11:14,876 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:11:14,876 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628274876"}]},"ts":"1689628274876"} 2023-07-17 21:11:14,878 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 21:11:14,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:14,966 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:11:14,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:11:14,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:11:14,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:11:14,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:11:14,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, ASSIGN}] 2023-07-17 21:11:14,984 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, ASSIGN 2023-07-17 21:11:14,984 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, ASSIGN 2023-07-17 21:11:14,986 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1689628244095; forceNewPlan=false, retain=false 2023-07-17 21:11:14,986 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689628244012; forceNewPlan=false, retain=false 2023-07-17 21:11:15,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:15,136 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:11:15,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c417a17750b594afc3686fb4b64072c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,139 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0ba6a173d12de8db664f3a904fc0fa16, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,139 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628275139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628275139"}]},"ts":"1689628275139"} 2023-07-17 21:11:15,139 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628275139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628275139"}]},"ts":"1689628275139"} 2023-07-17 21:11:15,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure c417a17750b594afc3686fb4b64072c8, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:11:15,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 0ba6a173d12de8db664f3a904fc0fa16, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:11:15,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c417a17750b594afc3686fb4b64072c8, NAME => 'testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:11:15,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. service=AccessControlService 2023-07-17 21:11:15,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:15,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:15,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:15,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ba6a173d12de8db664f3a904fc0fa16, NAME => 'testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:11:15,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. service=AccessControlService 2023-07-17 21:11:15,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:15,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:15,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,305 INFO [StoreOpener-c417a17750b594afc3686fb4b64072c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,306 INFO [StoreOpener-0ba6a173d12de8db664f3a904fc0fa16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,308 DEBUG [StoreOpener-c417a17750b594afc3686fb4b64072c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf 2023-07-17 21:11:15,308 DEBUG [StoreOpener-c417a17750b594afc3686fb4b64072c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf 2023-07-17 21:11:15,308 INFO [StoreOpener-c417a17750b594afc3686fb4b64072c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c417a17750b594afc3686fb4b64072c8 columnFamilyName cf 2023-07-17 21:11:15,309 DEBUG [StoreOpener-0ba6a173d12de8db664f3a904fc0fa16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf 2023-07-17 21:11:15,309 DEBUG [StoreOpener-0ba6a173d12de8db664f3a904fc0fa16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf 2023-07-17 21:11:15,309 INFO [StoreOpener-0ba6a173d12de8db664f3a904fc0fa16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ba6a173d12de8db664f3a904fc0fa16 columnFamilyName cf 2023-07-17 21:11:15,311 INFO [StoreOpener-0ba6a173d12de8db664f3a904fc0fa16-1] regionserver.HStore(310): Store=0ba6a173d12de8db664f3a904fc0fa16/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:15,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,312 INFO [StoreOpener-c417a17750b594afc3686fb4b64072c8-1] regionserver.HStore(310): Store=c417a17750b594afc3686fb4b64072c8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:15,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:15,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:15,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:15,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c417a17750b594afc3686fb4b64072c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60499533, jitterRate=-0.09848670661449432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:15,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c417a17750b594afc3686fb4b64072c8: 2023-07-17 21:11:15,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:15,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8., pid=30, masterSystemTime=1689628275294 2023-07-17 21:11:15,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ba6a173d12de8db664f3a904fc0fa16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65520825, jitterRate=-0.023663625121116638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:15,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ba6a173d12de8db664f3a904fc0fa16: 2023-07-17 21:11:15,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16., pid=31, masterSystemTime=1689628275295 2023-07-17 21:11:15,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c417a17750b594afc3686fb4b64072c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628275343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628275343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628275343"}]},"ts":"1689628275343"} 2023-07-17 21:11:15,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:15,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:15,345 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0ba6a173d12de8db664f3a904fc0fa16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,346 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628275345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628275345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628275345"}]},"ts":"1689628275345"} 2023-07-17 21:11:15,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-17 21:11:15,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure c417a17750b594afc3686fb4b64072c8, server=jenkins-hbase4.apache.org,46043,1689628244012 in 206 msec 2023-07-17 21:11:15,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-17 21:11:15,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 0ba6a173d12de8db664f3a904fc0fa16, server=jenkins-hbase4.apache.org,39595,1689628244095 in 206 msec 2023-07-17 21:11:15,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, ASSIGN in 383 msec 2023-07-17 21:11:15,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-17 21:11:15,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, ASSIGN in 384 msec 2023-07-17 21:11:15,358 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:11:15,358 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628275358"}]},"ts":"1689628275358"} 2023-07-17 21:11:15,360 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 21:11:15,364 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:11:15,365 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 21:11:15,367 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:11:15,372 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,372 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,372 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,372 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,375 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:15,375 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:15,375 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:15,375 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:15,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 570 msec 2023-07-17 21:11:15,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:15,415 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 21:11:15,418 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 21:11:15,418 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,420 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:15,433 DEBUG [hconnection-0x40158772-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,437 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628275444 (current time:1689628275444). 2023-07-17 21:11:15,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:15,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x694445f4 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:15,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3466d9ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:15,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,459 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x694445f4 to 127.0.0.1:60809 2023-07-17 21:11:15,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:15,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x574a4900 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:15,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ceacdf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:15,468 DEBUG [hconnection-0x1ec156bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,468 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x574a4900 to 127.0.0.1:60809 2023-07-17 21:11:15,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:15,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:11:15,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:15,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,478 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,479 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628875479 2023-07-17 21:11:15,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 21:11:15,480 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:15,480 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:15,481 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-17 21:11:15,484 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,487 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628875487 2023-07-17 21:11:15,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,549 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 21:11:15,549 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,551 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 21:11:15,551 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:11:15,551 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,551 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,554 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,554 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,555 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,555 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,555 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,555 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,556 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,556 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:15,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:15,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,558 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:15,558 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:15,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,561 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:15,561 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,563 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:15,563 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:15,563 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:15,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 21:11:15,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:15,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,565 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:15,565 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,566 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:15,566 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:15,566 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:15,572 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,572 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,573 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,573 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:15,573 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,573 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,574 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,574 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,574 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:15,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a87c034[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,580 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:15,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:15,582 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:15,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:15,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a87c034[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:15,588 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:11:15,588 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:15,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,590 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,590 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:15,590 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:15,590 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:15,590 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. started... 2023-07-17 21:11:15,590 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:15,591 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:15,591 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:15,591 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:15,591 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:15,591 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:11:15,594 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,594 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,594 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:15,594 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. started... 2023-07-17 21:11:15,594 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ba6a173d12de8db664f3a904fc0fa16: 2023-07-17 21:11:15,595 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,595 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:15,595 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:15,595 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c417a17750b594afc3686fb4b64072c8: 2023-07-17 21:11:15,595 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,595 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:15,596 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:15,630 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. completed. 2023-07-17 21:11:15,630 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:11:15,631 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. completed. 2023-07-17 21:11:15,631 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,631 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:15,631 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:15,631 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,631 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:15,631 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:11:15,633 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:15,633 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,633 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,633 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:15,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,638 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,638 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:15,638 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,638 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:11:15,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:11:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:11:15,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:11:15,650 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 21:11:15,650 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:15,650 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:15,650 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,650 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:15,652 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,652 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,652 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,652 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,652 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,653 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,653 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,654 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,655 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,656 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,659 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,659 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,660 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,667 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-17 21:11:15,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,667 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,669 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:15,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:11:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,669 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,670 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:15,670 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:15,670 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,670 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 21:11:15,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 21:11:15,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,766 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689628275479Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689628275685 (+206 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689628275685Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689628275685Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689628275690 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689628275711 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689628275765 (+54 ms) 2023-07-17 21:11:15,769 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 289 msec 2023-07-17 21:11:15,782 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:15,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:15,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:15,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:15,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:15,799 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 21:11:15,799 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:15,800 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:15,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628275816 (current time:1689628275816). 2023-07-17 21:11:15,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:15,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x227e6dc8 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:15,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f2ece7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:15,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,864 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x227e6dc8 to 127.0.0.1:60809 2023-07-17 21:11:15,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:15,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x5fb07975 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:15,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@701a1f9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:15,891 DEBUG [hconnection-0x41aabc32-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,896 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fb07975 to 127.0.0.1:60809 2023-07-17 21:11:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:11:15,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:15,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,914 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,916 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628875916 2023-07-17 21:11:15,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,916 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 21:11:15,918 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:15,919 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:15,920 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-17 21:11:15,923 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,924 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628875924 2023-07-17 21:11:15,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 21:11:15,963 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 21:11:15,963 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,965 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 21:11:15,965 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:11:16,017 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,017 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,019 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:16,019 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,019 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,019 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,020 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:16,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:16,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,022 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,022 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,022 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:16,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 21:11:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:16,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 21:11:16,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:16,024 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,024 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 21:11:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:16,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,027 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:16,027 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,027 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:16,027 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,032 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:16,032 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:16,032 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,032 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:16,032 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:16,036 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,036 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,041 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,042 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:16,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:16,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:16,047 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:11:16,047 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:16,049 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,049 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:16,049 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:11:16,049 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. started... 2023-07-17 21:11:16,049 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:16,050 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. started... 2023-07-17 21:11:16,050 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,050 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c417a17750b594afc3686fb4b64072c8 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 21:11:16,050 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:16,050 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0ba6a173d12de8db664f3a904fc0fa16 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 21:11:16,052 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:16,052 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,052 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:16,088 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717a16b1e9a898e45da92976d4dd39dfc3f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717a16b1e9a898e45da92976d4dd39dfc3f 2023-07-17 21:11:16,097 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230717a7aee06ae6614c428e3721274f7298fb to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230717a7aee06ae6614c428e3721274f7298fb 2023-07-17 21:11:16,114 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/.tmp/cf/4f7d2f8452f14c50a73b9a030c631a4f 2023-07-17 21:11:16,121 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/.tmp/cf/4f7d2f8452f14c50a73b9a030c631a4f as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf/4f7d2f8452f14c50a73b9a030c631a4f 2023-07-17 21:11:16,123 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/.tmp/cf/e1423b295dc348b98f2a774661853ee2 2023-07-17 21:11:16,128 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf/4f7d2f8452f14c50a73b9a030c631a4f, entries=3, sequenceid=6, filesize=5.4 K 2023-07-17 21:11:16,130 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c417a17750b594afc3686fb4b64072c8 in 80ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:16,130 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 21:11:16,131 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/.tmp/cf/e1423b295dc348b98f2a774661853ee2 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf/e1423b295dc348b98f2a774661853ee2 2023-07-17 21:11:16,131 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c417a17750b594afc3686fb4b64072c8: 2023-07-17 21:11:16,131 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,131 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:16,131 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf/4f7d2f8452f14c50a73b9a030c631a4f] hfiles 2023-07-17 21:11:16,131 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf/4f7d2f8452f14c50a73b9a030c631a4f for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,137 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf/e1423b295dc348b98f2a774661853ee2, entries=47, sequenceid=6, filesize=12.8 K 2023-07-17 21:11:16,138 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0ba6a173d12de8db664f3a904fc0fa16 in 88ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:16,140 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ba6a173d12de8db664f3a904fc0fa16: 2023-07-17 21:11:16,140 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,140 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:16,140 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf/e1423b295dc348b98f2a774661853ee2] hfiles 2023-07-17 21:11:16,140 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf/e1423b295dc348b98f2a774661853ee2 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,142 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. completed. 2023-07-17 21:11:16,142 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:16,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:16,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:16,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:16,142 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:11:16,149 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:16,149 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,149 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,149 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:16,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:11:16,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:11:16,158 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. completed. 2023-07-17 21:11:16,158 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:16,158 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:11:16,160 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,160 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:16,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:11:16,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:11:16,167 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 21:11:16,167 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:16,167 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:16,167 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,167 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,169 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,170 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,171 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,172 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,174 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,174 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,175 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,177 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,177 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,177 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:16,178 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,180 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 21:11:16,178 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-17 21:11:16,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,181 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:16,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:11:16,181 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:16,181 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,181 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230717a7aee06ae6614c428e3721274f7298fb, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717a16b1e9a898e45da92976d4dd39dfc3f] mob files 2023-07-17 21:11:16,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230717a7aee06ae6614c428e3721274f7298fb 2023-07-17 21:11:16,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717a16b1e9a898e45da92976d4dd39dfc3f 2023-07-17 21:11:16,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 21:11:16,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,222 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:16,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:16,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:16,224 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:11:16,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 21:11:16,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,234 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689628275917Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689628276190 (+273 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689628276190Loading Region manifests for snaptb0-testExportFileSystemState at 1689628276190Writing data manifest for snaptb0-testExportFileSystemState at 1689628276194 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689628276202 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689628276233 (+31 ms) 2023-07-17 21:11:16,237 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:16,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 319 msec 2023-07-17 21:11:16,524 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:16,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:16,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:16,525 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525 2023-07-17 21:11:16,526 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34459, tgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525, rawTgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:11:16,550 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:11:16,550 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1794850924_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,550 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 21:11:16,566 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,613 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:16,613 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:16,614 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:16,614 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,531 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-6604814607705087471.jar 2023-07-17 21:11:17,531 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,532 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,603 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-7911308401228122747.jar 2023-07-17 21:11:17,604 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,604 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,605 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,605 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,606 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,606 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,607 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:11:17,607 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:11:17,607 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:11:17,608 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:11:17,608 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:11:17,609 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:11:17,609 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:11:17,610 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:11:17,610 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:11:17,611 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:11:17,611 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:17,612 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:17,612 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:17,613 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:17,613 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:17,613 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:17,614 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:18,121 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:18,124 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 21:11:18,127 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-17 21:11:18,537 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:18,537 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:18,543 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:19,504 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:19,971 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:11:24,428 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:26,663 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:29,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:31,390 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:11:31,394 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:11:31,405 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 21:11:31,405 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:11:31,406 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:11:31,406 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 21:11:31,407 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 21:11:31,407 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 21:11:31,407 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 21:11:31,407 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 21:11:31,407 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628276525/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 21:11:31,415 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 21:11:31,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 21:11:31,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 21:11:31,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628291421"}]},"ts":"1689628291421"} 2023-07-17 21:11:31,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 21:11:31,425 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 21:11:31,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, UNASSIGN}] 2023-07-17 21:11:31,428 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, UNASSIGN 2023-07-17 21:11:31,428 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, UNASSIGN 2023-07-17 21:11:31,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c417a17750b594afc3686fb4b64072c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:31,431 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0ba6a173d12de8db664f3a904fc0fa16, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:31,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628291431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628291431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628291431"}]},"ts":"1689628291431"} 2023-07-17 21:11:31,431 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628291431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628291431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628291431"}]},"ts":"1689628291431"} 2023-07-17 21:11:31,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c417a17750b594afc3686fb4b64072c8, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:11:31,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 0ba6a173d12de8db664f3a904fc0fa16, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:11:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 21:11:31,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:31,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c417a17750b594afc3686fb4b64072c8, disabling compactions & flushes 2023-07-17 21:11:31,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:31,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:31,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:31,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. after waiting 0 ms 2023-07-17 21:11:31,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:31,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ba6a173d12de8db664f3a904fc0fa16, disabling compactions & flushes 2023-07-17 21:11:31,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:31,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:31,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. after waiting 0 ms 2023-07-17 21:11:31,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:31,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:31,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:31,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:31,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:31,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16. 2023-07-17 21:11:31,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ba6a173d12de8db664f3a904fc0fa16: 2023-07-17 21:11:31,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8. 2023-07-17 21:11:31,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c417a17750b594afc3686fb4b64072c8: 2023-07-17 21:11:31,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:31,607 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0ba6a173d12de8db664f3a904fc0fa16, regionState=CLOSED 2023-07-17 21:11:31,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628291607"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291607"}]},"ts":"1689628291607"} 2023-07-17 21:11:31,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:31,608 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c417a17750b594afc3686fb4b64072c8, regionState=CLOSED 2023-07-17 21:11:31,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628291608"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291608"}]},"ts":"1689628291608"} 2023-07-17 21:11:31,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-17 21:11:31,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 0ba6a173d12de8db664f3a904fc0fa16, server=jenkins-hbase4.apache.org,39595,1689628244095 in 174 msec 2023-07-17 21:11:31,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-17 21:11:31,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c417a17750b594afc3686fb4b64072c8, server=jenkins-hbase4.apache.org,46043,1689628244012 in 176 msec 2023-07-17 21:11:31,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0ba6a173d12de8db664f3a904fc0fa16, UNASSIGN in 187 msec 2023-07-17 21:11:31,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-17 21:11:31,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c417a17750b594afc3686fb4b64072c8, UNASSIGN in 188 msec 2023-07-17 21:11:31,617 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628291616"}]},"ts":"1689628291616"} 2023-07-17 21:11:31,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 21:11:31,620 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 21:11:31,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 206 msec 2023-07-17 21:11:31,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 21:11:31,723 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 21:11:31,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 21:11:31,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 21:11:31,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,731 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 21:11:31,734 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,734 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,734 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,734 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 21:11:31,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 21:11:31,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 21:11:31,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 21:11:31,735 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:31,735 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:31,736 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,736 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,736 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,736 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,736 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,736 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,737 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,737 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 21:11:31,738 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/recovered.edits] 2023-07-17 21:11:31,738 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/recovered.edits] 2023-07-17 21:11:31,743 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf/4f7d2f8452f14c50a73b9a030c631a4f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/cf/4f7d2f8452f14c50a73b9a030c631a4f 2023-07-17 21:11:31,743 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf/e1423b295dc348b98f2a774661853ee2 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/cf/e1423b295dc348b98f2a774661853ee2 2023-07-17 21:11:31,747 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8/recovered.edits/9.seqid 2023-07-17 21:11:31,747 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16/recovered.edits/9.seqid 2023-07-17 21:11:31,747 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/c417a17750b594afc3686fb4b64072c8 2023-07-17 21:11:31,748 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemState/0ba6a173d12de8db664f3a904fc0fa16 2023-07-17 21:11:31,748 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 21:11:31,748 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-17 21:11:31,749 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-17 21:11:31,753 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230717a7aee06ae6614c428e3721274f7298fb to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230717a7aee06ae6614c428e3721274f7298fb 2023-07-17 21:11:31,755 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717a16b1e9a898e45da92976d4dd39dfc3f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717a16b1e9a898e45da92976d4dd39dfc3f 2023-07-17 21:11:31,755 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-17 21:11:31,762 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,767 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 21:11:31,773 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 21:11:31,774 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,774 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 21:11:31,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628291774"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:31,775 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628291774"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:31,777 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:11:31,777 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c417a17750b594afc3686fb4b64072c8, NAME => 'testtb-testExportFileSystemState,,1689628274803.c417a17750b594afc3686fb4b64072c8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0ba6a173d12de8db664f3a904fc0fa16, NAME => 'testtb-testExportFileSystemState,1,1689628274803.0ba6a173d12de8db664f3a904fc0fa16.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:11:31,777 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 21:11:31,777 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628291777"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:31,779 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 21:11:31,781 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 57 msec 2023-07-17 21:11:31,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 21:11:31,839 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 21:11:31,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 21:11:31,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:31,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 21:11:31,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 21:11:31,895 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 752) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-872402872_1 at /127.0.0.1:38380 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:40979 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:48172 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-872402872_1 at /127.0.0.1:49192 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:48836 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:33396 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=458 (was 280) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2992 (was 3120) 2023-07-17 21:11:31,896 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-17 21:11:31,918 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=458, ProcessCount=183, AvailableMemoryMB=2990 2023-07-17 21:11:31,918 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-17 21:11:31,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 21:11:31,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:11:31,923 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:11:31,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 21:11:31,924 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:11:31,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:31,930 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:31,931 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:31,931 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 empty. 2023-07-17 21:11:31,931 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb empty. 2023-07-17 21:11:31,932 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:31,932 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:31,932 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 21:11:31,948 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 21:11:31,949 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a830a7771abf99b4ec31e6225046bd71, NAME => 'testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:11:31,950 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 07aa2930e44ed34175272f02f25784eb, NAME => 'testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a830a7771abf99b4ec31e6225046bd71, disabling compactions & flushes 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 07aa2930e44ed34175272f02f25784eb, disabling compactions & flushes 2023-07-17 21:11:31,987 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:31,987 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. after waiting 0 ms 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. after waiting 0 ms 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:31,987 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:31,987 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:31,988 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:31,988 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a830a7771abf99b4ec31e6225046bd71: 2023-07-17 21:11:31,988 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 07aa2930e44ed34175272f02f25784eb: 2023-07-17 21:11:31,990 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:11:31,991 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291991"}]},"ts":"1689628291991"} 2023-07-17 21:11:31,991 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291991"}]},"ts":"1689628291991"} 2023-07-17 21:11:31,993 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:11:31,994 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:11:31,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628291994"}]},"ts":"1689628291994"} 2023-07-17 21:11:31,996 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 21:11:31,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:11:32,001 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:11:32,001 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:11:32,001 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:11:32,001 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:11:32,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, ASSIGN}] 2023-07-17 21:11:32,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, ASSIGN 2023-07-17 21:11:32,003 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, ASSIGN 2023-07-17 21:11:32,004 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689628244012; forceNewPlan=false, retain=false 2023-07-17 21:11:32,004 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1689628244095; forceNewPlan=false, retain=false 2023-07-17 21:11:32,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:32,154 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:11:32,158 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=07aa2930e44ed34175272f02f25784eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a830a7771abf99b4ec31e6225046bd71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628292158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628292158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628292158"}]},"ts":"1689628292158"} 2023-07-17 21:11:32,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628292158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628292158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628292158"}]},"ts":"1689628292158"} 2023-07-17 21:11:32,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 07aa2930e44ed34175272f02f25784eb, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:11:32,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a830a7771abf99b4ec31e6225046bd71, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:11:32,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:32,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:32,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07aa2930e44ed34175272f02f25784eb, NAME => 'testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:11:32,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. service=AccessControlService 2023-07-17 21:11:32,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a830a7771abf99b4ec31e6225046bd71, NAME => 'testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. service=AccessControlService 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:32,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,320 INFO [StoreOpener-07aa2930e44ed34175272f02f25784eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,320 INFO [StoreOpener-a830a7771abf99b4ec31e6225046bd71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,321 DEBUG [StoreOpener-07aa2930e44ed34175272f02f25784eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf 2023-07-17 21:11:32,321 DEBUG [StoreOpener-a830a7771abf99b4ec31e6225046bd71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf 2023-07-17 21:11:32,321 DEBUG [StoreOpener-a830a7771abf99b4ec31e6225046bd71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf 2023-07-17 21:11:32,321 DEBUG [StoreOpener-07aa2930e44ed34175272f02f25784eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf 2023-07-17 21:11:32,322 INFO [StoreOpener-a830a7771abf99b4ec31e6225046bd71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a830a7771abf99b4ec31e6225046bd71 columnFamilyName cf 2023-07-17 21:11:32,322 INFO [StoreOpener-07aa2930e44ed34175272f02f25784eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07aa2930e44ed34175272f02f25784eb columnFamilyName cf 2023-07-17 21:11:32,323 INFO [StoreOpener-a830a7771abf99b4ec31e6225046bd71-1] regionserver.HStore(310): Store=a830a7771abf99b4ec31e6225046bd71/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:32,323 INFO [StoreOpener-07aa2930e44ed34175272f02f25784eb-1] regionserver.HStore(310): Store=07aa2930e44ed34175272f02f25784eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:32,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:11:32,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:11:32,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:32,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:32,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07aa2930e44ed34175272f02f25784eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65114715, jitterRate=-0.02971513569355011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:32,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07aa2930e44ed34175272f02f25784eb: 2023-07-17 21:11:32,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a830a7771abf99b4ec31e6225046bd71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63008806, jitterRate=-0.061095625162124634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:32,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a830a7771abf99b4ec31e6225046bd71: 2023-07-17 21:11:32,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb., pid=45, masterSystemTime=1689628292313 2023-07-17 21:11:32,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71., pid=46, masterSystemTime=1689628292314 2023-07-17 21:11:32,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:32,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:32,334 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=07aa2930e44ed34175272f02f25784eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,334 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628292333"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628292333"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628292333"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628292333"}]},"ts":"1689628292333"} 2023-07-17 21:11:32,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a830a7771abf99b4ec31e6225046bd71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628292334"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628292334"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628292334"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628292334"}]},"ts":"1689628292334"} 2023-07-17 21:11:32,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-17 21:11:32,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 07aa2930e44ed34175272f02f25784eb, server=jenkins-hbase4.apache.org,39595,1689628244095 in 176 msec 2023-07-17 21:11:32,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-17 21:11:32,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a830a7771abf99b4ec31e6225046bd71, server=jenkins-hbase4.apache.org,46043,1689628244012 in 176 msec 2023-07-17 21:11:32,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, ASSIGN in 341 msec 2023-07-17 21:11:32,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-17 21:11:32,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, ASSIGN in 342 msec 2023-07-17 21:11:32,346 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:11:32,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628292346"}]},"ts":"1689628292346"} 2023-07-17 21:11:32,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 21:11:32,350 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:11:32,350 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 21:11:32,352 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 21:11:32,355 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:32,355 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:32,355 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:32,355 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:32,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:32,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:32,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:32,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:32,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 437 msec 2023-07-17 21:11:32,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:32,529 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 21:11:32,532 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 21:11:32,533 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,534 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:32,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628292551 (current time:1689628292551). 2023-07-17 21:11:32,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:32,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x370c8b2b to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@286f7f70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,566 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x370c8b2b to 127.0.0.1:60809 2023-07-17 21:11:32,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x431c5a09 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@109ac492, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,579 DEBUG [hconnection-0x435dad0e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,582 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x431c5a09 to 127.0.0.1:60809 2023-07-17 21:11:32,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 21:11:32,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:32,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,592 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,593 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689628892593 2023-07-17 21:11:32,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 21:11:32,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,595 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:32,595 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:32,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,604 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 14 msec 2023-07-17 21:11:32,607 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,610 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689628892610 2023-07-17 21:11:32,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,633 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 21:11:32,633 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,634 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 21:11:32,635 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 21:11:32,635 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,635 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,636 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,636 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,636 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,637 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,637 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,637 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,637 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,638 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,638 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,639 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,639 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,639 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,640 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,641 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,639 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,641 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,641 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,641 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,645 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,649 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,649 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,650 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,650 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:32,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:32,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:32,656 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 21:11:32,657 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,658 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:11:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:32,659 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,659 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:32,659 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,659 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. started... 2023-07-17 21:11:32,659 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. started... 2023-07-17 21:11:32,659 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07aa2930e44ed34175272f02f25784eb: 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a830a7771abf99b4ec31e6225046bd71: 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:32,661 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,666 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,686 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. completed. 2023-07-17 21:11:32,687 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:11:32,687 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. completed. 2023-07-17 21:11:32,687 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:11:32,689 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,690 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,690 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,690 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,690 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,695 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:32,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,697 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:11:32,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 21:11:32,699 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 21:11:32,699 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:32,699 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:32,699 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,699 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,701 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,701 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,702 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,703 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,705 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,705 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,705 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,710 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-17 21:11:32,710 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:11:32,712 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,713 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,713 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,713 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:32,713 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,713 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 21:11:32,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 21:11:32,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,772 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689628292593Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689628292725 (+132 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689628292725Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689628292725Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689628292728 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689628292737 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689628292771 (+34 ms) 2023-07-17 21:11:32,777 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 184 msec 2023-07-17 21:11:32,897 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:32,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:32,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:32,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:32,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:32,906 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 21:11:32,906 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:32,906 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:32,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628292918 (current time:1689628292918). 2023-07-17 21:11:32,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:32,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x0735b34b to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cafea32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,938 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0735b34b to 127.0.0.1:60809 2023-07-17 21:11:32,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x1d8ece76 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@370b8967, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,947 DEBUG [hconnection-0x24e60bce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,948 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d8ece76 to 127.0.0.1:60809 2023-07-17 21:11:32,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 21:11:32,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:32,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,958 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,959 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689628892959 2023-07-17 21:11:32,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 21:11:32,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,960 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:32,960 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:32,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,963 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-17 21:11:32,965 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,966 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689628892966 2023-07-17 21:11:32,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 21:11:32,984 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 21:11:32,984 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,986 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 21:11:32,986 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 21:11:32,987 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,987 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,989 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,989 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,989 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,989 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,990 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,990 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,990 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,991 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,991 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,991 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,992 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,993 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,993 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,995 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,996 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,996 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,996 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,996 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,996 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,997 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,999 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:33,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:33,002 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:33,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:33,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:33,006 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 21:11:33,006 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:33,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,007 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:33,008 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:33,007 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:33,008 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. started... 2023-07-17 21:11:33,008 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,008 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:11:33,008 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a830a7771abf99b4ec31e6225046bd71 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-17 21:11:33,008 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:33,008 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:33,008 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. started... 2023-07-17 21:11:33,009 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 07aa2930e44ed34175272f02f25784eb 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-17 21:11:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:33,039 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230717844c70812edf4605812f2bf37b8c5a41 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230717844c70812edf4605812f2bf37b8c5a41 2023-07-17 21:11:33,039 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071752383ae72cc046178331df0ae772f70f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071752383ae72cc046178331df0ae772f70f 2023-07-17 21:11:33,054 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/.tmp/cf/3ac04b3092a34bf9a98e64ec191e729f 2023-07-17 21:11:33,054 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/.tmp/cf/070d3602928146df8c61e26d6bc7b7e9 2023-07-17 21:11:33,060 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:33,060 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/.tmp/cf/3ac04b3092a34bf9a98e64ec191e729f as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf/3ac04b3092a34bf9a98e64ec191e729f 2023-07-17 21:11:33,060 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/.tmp/cf/070d3602928146df8c61e26d6bc7b7e9 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf/070d3602928146df8c61e26d6bc7b7e9 2023-07-17 21:11:33,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:33,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:33,062 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:33,065 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf/3ac04b3092a34bf9a98e64ec191e729f, entries=5, sequenceid=6, filesize=5.7 K 2023-07-17 21:11:33,066 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a830a7771abf99b4ec31e6225046bd71 in 58ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:33,067 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 21:11:33,067 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf/070d3602928146df8c61e26d6bc7b7e9, entries=45, sequenceid=6, filesize=12.4 K 2023-07-17 21:11:33,067 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a830a7771abf99b4ec31e6225046bd71: 2023-07-17 21:11:33,067 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:33,067 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:33,067 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf/3ac04b3092a34bf9a98e64ec191e729f] hfiles 2023-07-17 21:11:33,067 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf/3ac04b3092a34bf9a98e64ec191e729f for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:33,067 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 07aa2930e44ed34175272f02f25784eb in 58ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:33,069 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07aa2930e44ed34175272f02f25784eb: 2023-07-17 21:11:33,069 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:33,069 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:33,069 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf/070d3602928146df8c61e26d6bc7b7e9] hfiles 2023-07-17 21:11:33,069 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf/070d3602928146df8c61e26d6bc7b7e9 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:33,081 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. completed. 2023-07-17 21:11:33,081 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. completed. 2023-07-17 21:11:33,081 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:11:33,082 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:11:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:33,084 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:33,085 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:33,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:33,085 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:33,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:33,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:11:33,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 21:11:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:11:33,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 21:11:33,094 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 21:11:33,094 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:33,094 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:33,094 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 21:11:33,094 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,097 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:33,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:33,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:33,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:33,098 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:33,099 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:33,103 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:33,104 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,104 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:33,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 21:11:33,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:33,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:33,111 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:33,111 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:33,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:33,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,112 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:33,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:33,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:33,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230717844c70812edf4605812f2bf37b8c5a41, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071752383ae72cc046178331df0ae772f70f] mob files 2023-07-17 21:11:33,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230717844c70812edf4605812f2bf37b8c5a41 2023-07-17 21:11:33,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071752383ae72cc046178331df0ae772f70f 2023-07-17 21:11:33,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 21:11:33,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 21:11:33,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,179 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689628292959Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689628293129 (+170 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689628293129Loading Region manifests for snaptb0-testConsecutiveExports at 1689628293129Writing data manifest for snaptb0-testConsecutiveExports at 1689628293134 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689628293151 (+17 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689628293179 (+28 ms) 2023-07-17 21:11:33,182 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:33,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 222 msec 2023-07-17 21:11:33,262 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:33,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:33,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:33,264 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264 2023-07-17 21:11:33,264 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:11:33,287 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:11:33,287 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3e4ce8cd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,287 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 21:11:33,295 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:33,311 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,312 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,312 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,312 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,297 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-9162762264545610950.jar 2023-07-17 21:11:34,298 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,298 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,372 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-9060029933859517275.jar 2023-07-17 21:11:34,372 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,373 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,373 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,373 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,374 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,374 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:34,375 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:11:34,376 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:11:34,376 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:11:34,377 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:11:34,377 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:11:34,378 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:11:34,378 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:11:34,379 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:11:34,379 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:11:34,379 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:11:34,380 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:34,381 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:34,381 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:34,381 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:34,382 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:34,382 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:34,383 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:35,163 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:35,166 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 21:11:35,168 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-17 21:11:35,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:35,939 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:35,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:36,549 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:37,204 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:11:41,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:43,520 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:46,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:48,341 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:11:48,341 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:11:48,345 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 21:11:48,345 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:11:48,346 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:11:48,346 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:11:48,348 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:11:48,348 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:11:48,348 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@97dec39 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:11:48,349 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:11:48,349 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:11:48,350 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:11:48,372 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:11:48,372 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@aec4837, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:48,372 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 21:11:48,384 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:48,402 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,403 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,403 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,403 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,385 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-7837475494666215039.jar 2023-07-17 21:11:49,385 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,385 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,452 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-4020783845893987371.jar 2023-07-17 21:11:49,453 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,453 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,454 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,454 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,454 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,455 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:49,455 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:11:49,455 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:11:49,456 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:11:49,456 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:11:49,456 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:11:49,457 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:11:49,457 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:11:49,458 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:11:49,458 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:11:49,459 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:11:49,459 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:49,459 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:49,461 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:49,462 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:49,876 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:49,878 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 21:11:49,880 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-17 21:11:52,516 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:52,517 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:52,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:52,962 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0004_000001 (auth:SIMPLE) 2023-07-17 21:11:57,620 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0004_000001 (auth:SIMPLE) 2023-07-17 21:11:59,861 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0004_000001 (auth:SIMPLE) 2023-07-17 21:12:03,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0004_000001 (auth:SIMPLE) 2023-07-17 21:12:05,089 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:12:05,090 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:12:05,108 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 21:12:05,108 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:12:05,108 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:12:05,108 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:12:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:12:05,121 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:12:05,121 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@97dec39 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:12:05,121 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:12:05,121 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/local-export-1689628293264/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:12:05,136 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 21:12:05,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 21:12:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 21:12:05,143 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628325143"}]},"ts":"1689628325143"} 2023-07-17 21:12:05,145 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 21:12:05,147 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 21:12:05,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, UNASSIGN}] 2023-07-17 21:12:05,149 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, UNASSIGN 2023-07-17 21:12:05,154 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, UNASSIGN 2023-07-17 21:12:05,154 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a830a7771abf99b4ec31e6225046bd71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:05,154 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628325154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628325154"}]},"ts":"1689628325154"} 2023-07-17 21:12:05,159 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=07aa2930e44ed34175272f02f25784eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:05,159 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628325159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628325159"}]},"ts":"1689628325159"} 2023-07-17 21:12:05,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure a830a7771abf99b4ec31e6225046bd71, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:12:05,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 07aa2930e44ed34175272f02f25784eb, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:05,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 21:12:05,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:12:05,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a830a7771abf99b4ec31e6225046bd71, disabling compactions & flushes 2023-07-17 21:12:05,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:12:05,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:12:05,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. after waiting 0 ms 2023-07-17 21:12:05,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:12:05,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:12:05,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07aa2930e44ed34175272f02f25784eb, disabling compactions & flushes 2023-07-17 21:12:05,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:12:05,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:12:05,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. after waiting 0 ms 2023-07-17 21:12:05,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:12:05,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:05,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:05,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71. 2023-07-17 21:12:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a830a7771abf99b4ec31e6225046bd71: 2023-07-17 21:12:05,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:05,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:05,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb. 2023-07-17 21:12:05,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07aa2930e44ed34175272f02f25784eb: 2023-07-17 21:12:05,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:12:05,345 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a830a7771abf99b4ec31e6225046bd71, regionState=CLOSED 2023-07-17 21:12:05,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07aa2930e44ed34175272f02f25784eb 2023-07-17 21:12:05,345 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628325345"}]},"ts":"1689628325345"} 2023-07-17 21:12:05,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=07aa2930e44ed34175272f02f25784eb, regionState=CLOSED 2023-07-17 21:12:05,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628325346"}]},"ts":"1689628325346"} 2023-07-17 21:12:05,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-17 21:12:05,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure a830a7771abf99b4ec31e6225046bd71, server=jenkins-hbase4.apache.org,46043,1689628244012 in 188 msec 2023-07-17 21:12:05,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-17 21:12:05,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 07aa2930e44ed34175272f02f25784eb, server=jenkins-hbase4.apache.org,39595,1689628244095 in 187 msec 2023-07-17 21:12:05,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a830a7771abf99b4ec31e6225046bd71, UNASSIGN in 203 msec 2023-07-17 21:12:05,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-17 21:12:05,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=07aa2930e44ed34175272f02f25784eb, UNASSIGN in 204 msec 2023-07-17 21:12:05,355 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628325355"}]},"ts":"1689628325355"} 2023-07-17 21:12:05,356 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 21:12:05,358 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 21:12:05,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 221 msec 2023-07-17 21:12:05,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 21:12:05,445 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 21:12:05,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 21:12:05,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,450 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 21:12:05,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,454 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 21:12:05,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:12:05,458 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,458 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb 2023-07-17 21:12:05,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,458 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,458 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,458 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,460 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/recovered.edits] 2023-07-17 21:12:05,460 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/recovered.edits] 2023-07-17 21:12:05,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,464 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,465 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,465 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 21:12:05,467 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf/3ac04b3092a34bf9a98e64ec191e729f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/cf/3ac04b3092a34bf9a98e64ec191e729f 2023-07-17 21:12:05,467 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf/070d3602928146df8c61e26d6bc7b7e9 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/cf/070d3602928146df8c61e26d6bc7b7e9 2023-07-17 21:12:05,471 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71/recovered.edits/9.seqid 2023-07-17 21:12:05,472 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/a830a7771abf99b4ec31e6225046bd71 2023-07-17 21:12:05,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb/recovered.edits/9.seqid 2023-07-17 21:12:05,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testConsecutiveExports/07aa2930e44ed34175272f02f25784eb 2023-07-17 21:12:05,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 21:12:05,475 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-17 21:12:05,476 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-17 21:12:05,481 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230717844c70812edf4605812f2bf37b8c5a41 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230717844c70812edf4605812f2bf37b8c5a41 2023-07-17 21:12:05,483 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071752383ae72cc046178331df0ae772f70f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071752383ae72cc046178331df0ae772f70f 2023-07-17 21:12:05,484 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-17 21:12:05,487 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,492 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 21:12:05,494 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 21:12:05,496 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,496 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 21:12:05,496 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628325496"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:05,496 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628325496"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:05,505 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:12:05,505 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a830a7771abf99b4ec31e6225046bd71, NAME => 'testtb-testConsecutiveExports,,1689628291919.a830a7771abf99b4ec31e6225046bd71.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 07aa2930e44ed34175272f02f25784eb, NAME => 'testtb-testConsecutiveExports,1,1689628291919.07aa2930e44ed34175272f02f25784eb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:12:05,505 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 21:12:05,505 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628325505"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:05,507 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 21:12:05,509 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 62 msec 2023-07-17 21:12:05,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 21:12:05,568 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 21:12:05,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 21:12:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 21:12:05,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 21:12:05,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 21:12:05,613 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 766), OpenFileDescriptor=891 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=416 (was 458), ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2974 (was 2990) 2023-07-17 21:12:05,613 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-17 21:12:05,640 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=891, MaxFileDescriptor=60000, SystemLoadAverage=416, ProcessCount=185, AvailableMemoryMB=2970 2023-07-17 21:12:05,640 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-17 21:12:05,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 21:12:05,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:05,659 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:05,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 21:12:05,660 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:05,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:05,665 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:05,666 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:05,667 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d empty. 2023-07-17 21:12:05,667 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:05,669 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 empty. 2023-07-17 21:12:05,669 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:05,669 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 21:12:05,747 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:05,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 67f86c4e5660c65a51eeb0d4f16eb728, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:05,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3b67d9adc5d45b38ac2e34d2822e703d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:05,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:05,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:05,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 67f86c4e5660c65a51eeb0d4f16eb728, disabling compactions & flushes 2023-07-17 21:12:05,827 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:05,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:05,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. after waiting 0 ms 2023-07-17 21:12:05,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:05,827 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:05,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 67f86c4e5660c65a51eeb0d4f16eb728: 2023-07-17 21:12:05,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:06,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:06,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 3b67d9adc5d45b38ac2e34d2822e703d, disabling compactions & flushes 2023-07-17 21:12:06,228 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. after waiting 0 ms 2023-07-17 21:12:06,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,228 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 3b67d9adc5d45b38ac2e34d2822e703d: 2023-07-17 21:12:06,232 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:06,233 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628326233"}]},"ts":"1689628326233"} 2023-07-17 21:12:06,233 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628326233"}]},"ts":"1689628326233"} 2023-07-17 21:12:06,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:06,240 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:06,241 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628326240"}]},"ts":"1689628326240"} 2023-07-17 21:12:06,242 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 21:12:06,245 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:06,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:06,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:06,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:06,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:06,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, ASSIGN}] 2023-07-17 21:12:06,250 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, ASSIGN 2023-07-17 21:12:06,250 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, ASSIGN 2023-07-17 21:12:06,251 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1689628244095; forceNewPlan=false, retain=false 2023-07-17 21:12:06,251 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1689628244150; forceNewPlan=false, retain=false 2023-07-17 21:12:06,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:06,401 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:06,405 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=67f86c4e5660c65a51eeb0d4f16eb728, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:06,405 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326405"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628326405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628326405"}]},"ts":"1689628326405"} 2023-07-17 21:12:06,405 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3b67d9adc5d45b38ac2e34d2822e703d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:06,406 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326405"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628326405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628326405"}]},"ts":"1689628326405"} 2023-07-17 21:12:06,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 67f86c4e5660c65a51eeb0d4f16eb728, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:06,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 3b67d9adc5d45b38ac2e34d2822e703d, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:06,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:06,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67f86c4e5660c65a51eeb0d4f16eb728, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:12:06,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. service=AccessControlService 2023-07-17 21:12:06,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:06,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:06,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b67d9adc5d45b38ac2e34d2822e703d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:12:06,571 INFO [StoreOpener-67f86c4e5660c65a51eeb0d4f16eb728-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. service=AccessControlService 2023-07-17 21:12:06,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:06,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:06,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,575 INFO [StoreOpener-3b67d9adc5d45b38ac2e34d2822e703d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,575 DEBUG [StoreOpener-67f86c4e5660c65a51eeb0d4f16eb728-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf 2023-07-17 21:12:06,575 DEBUG [StoreOpener-67f86c4e5660c65a51eeb0d4f16eb728-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf 2023-07-17 21:12:06,577 INFO [StoreOpener-67f86c4e5660c65a51eeb0d4f16eb728-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67f86c4e5660c65a51eeb0d4f16eb728 columnFamilyName cf 2023-07-17 21:12:06,579 INFO [StoreOpener-67f86c4e5660c65a51eeb0d4f16eb728-1] regionserver.HStore(310): Store=67f86c4e5660c65a51eeb0d4f16eb728/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:06,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,588 DEBUG [StoreOpener-3b67d9adc5d45b38ac2e34d2822e703d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf 2023-07-17 21:12:06,588 DEBUG [StoreOpener-3b67d9adc5d45b38ac2e34d2822e703d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf 2023-07-17 21:12:06,588 INFO [StoreOpener-3b67d9adc5d45b38ac2e34d2822e703d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b67d9adc5d45b38ac2e34d2822e703d columnFamilyName cf 2023-07-17 21:12:06,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:06,590 INFO [StoreOpener-3b67d9adc5d45b38ac2e34d2822e703d-1] regionserver.HStore(310): Store=3b67d9adc5d45b38ac2e34d2822e703d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:06,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:06,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:06,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:06,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b67d9adc5d45b38ac2e34d2822e703d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74271729, jitterRate=0.10673500597476959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:06,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 67f86c4e5660c65a51eeb0d4f16eb728; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71541069, jitterRate=0.06604500114917755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b67d9adc5d45b38ac2e34d2822e703d: 2023-07-17 21:12:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 67f86c4e5660c65a51eeb0d4f16eb728: 2023-07-17 21:12:06,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d., pid=61, masterSystemTime=1689628326562 2023-07-17 21:12:06,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728., pid=60, masterSystemTime=1689628326560 2023-07-17 21:12:06,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,604 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3b67d9adc5d45b38ac2e34d2822e703d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:06,604 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628326604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628326604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628326604"}]},"ts":"1689628326604"} 2023-07-17 21:12:06,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:06,605 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=67f86c4e5660c65a51eeb0d4f16eb728, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:06,605 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628326605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628326605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628326605"}]},"ts":"1689628326605"} 2023-07-17 21:12:06,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-17 21:12:06,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 3b67d9adc5d45b38ac2e34d2822e703d, server=jenkins-hbase4.apache.org,44933,1689628244150 in 198 msec 2023-07-17 21:12:06,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-17 21:12:06,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 67f86c4e5660c65a51eeb0d4f16eb728, server=jenkins-hbase4.apache.org,39595,1689628244095 in 200 msec 2023-07-17 21:12:06,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, ASSIGN in 363 msec 2023-07-17 21:12:06,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-17 21:12:06,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, ASSIGN in 364 msec 2023-07-17 21:12:06,615 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:06,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628326615"}]},"ts":"1689628326615"} 2023-07-17 21:12:06,616 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 21:12:06,619 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:06,619 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 21:12:06,623 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 21:12:06,625 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,625 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,625 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,625 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,627 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,627 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 984 msec 2023-07-17 21:12:06,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:06,768 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 21:12:06,771 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,771 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:06,775 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:06,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:06,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628326793 (current time:1689628326793). 2023-07-17 21:12:06,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:06,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x7d3100cd to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:06,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740cebda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:06,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:06,819 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:06,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d3100cd to 127.0.0.1:60809 2023-07-17 21:12:06,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:06,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x68ffa45d to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dbde6e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:06,930 DEBUG [hconnection-0xefc9cb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:06,935 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:06,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68ffa45d to 127.0.0.1:60809 2023-07-17 21:12:06,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:06,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 21:12:06,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:06,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:06,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:06,956 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:06,957 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689628926957 2023-07-17 21:12:06,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:06,959 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:06,959 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:06,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:06,960 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:06,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 21:12:06,962 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:06,963 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689628926963 2023-07-17 21:12:07,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,011 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 21:12:07,011 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,013 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 21:12:07,013 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 21:12:07,013 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,014 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,015 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,015 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,015 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:07,017 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,018 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:07,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,018 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,018 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,018 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,018 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:07,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:07,029 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,031 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,031 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,031 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,031 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,032 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,032 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,037 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,037 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:07,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:07,038 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 21:12:07,038 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,039 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,040 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:07,040 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,040 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:07,040 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,041 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,041 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:07,042 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:07,043 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:07,043 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:07,043 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. started... 2023-07-17 21:12:07,043 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b67d9adc5d45b38ac2e34d2822e703d: 2023-07-17 21:12:07,043 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,043 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:07,044 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:07,044 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,044 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:07,044 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:07,044 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:07,046 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:07,046 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:07,047 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:07,047 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. started... 2023-07-17 21:12:07,050 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 67f86c4e5660c65a51eeb0d4f16eb728: 2023-07-17 21:12:07,050 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,050 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:07,050 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:07,053 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:07,053 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:07,053 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:07,061 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:07,062 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:07,175 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. completed. 2023-07-17 21:12:07,175 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:07,178 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. completed. 2023-07-17 21:12:07,178 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:07,178 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:07,178 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:07,178 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,179 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:07,179 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:07,201 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,201 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:07,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,201 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:07,201 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:07,247 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,247 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,247 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:07,248 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:07,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 21:12:07,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:12:07,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 21:12:07,260 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 21:12:07,260 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:07,260 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:07,260 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,260 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:07,263 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:07,264 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:07,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:07,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:07,286 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:07,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:07,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:07,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:07,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:07,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,288 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,288 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,290 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,291 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,291 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,324 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:07,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,325 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,325 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,325 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:12:07,327 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:07,327 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:07,327 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:07,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:07,328 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:07,328 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,328 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:07,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 21:12:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:07,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,420 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 21:12:07,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,421 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689628326957Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689628327364 (+407 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628327364Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628327364Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628327371 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628327388 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689628327420 (+32 ms) 2023-07-17 21:12:07,424 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:07,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 466 msec 2023-07-17 21:12:07,564 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:07,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:07,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:07,576 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,576 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:07,576 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:07,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:07,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628327587 (current time:1689628327587). 2023-07-17 21:12:07,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:07,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x58e3936b to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:07,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fec775d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:07,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:07,736 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:07,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58e3936b to 127.0.0.1:60809 2023-07-17 21:12:07,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:07,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x3fc5125c to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:07,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b79b604, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:07,850 DEBUG [hconnection-0x174370a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:07,854 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:07,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fc5125c to 127.0.0.1:60809 2023-07-17 21:12:07,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:07,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 21:12:07,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:07,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:07,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:07,872 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:07,873 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689628927873 2023-07-17 21:12:07,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:07,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,875 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:07,875 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:07,876 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:07,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:07,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 21:12:07,879 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:07,880 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689628927880 2023-07-17 21:12:07,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,894 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 21:12:07,894 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,896 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 21:12:07,896 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 21:12:07,916 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,916 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,975 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:07,976 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:08,009 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,009 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,009 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,009 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,009 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,009 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,010 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:08,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:08,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,011 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:08,011 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:08,011 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:08,011 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:08,011 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:08,013 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:08,011 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:08,015 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:08,014 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:08,055 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,132 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,132 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:08,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:08,136 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 21:12:08,136 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,176 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:08,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:08,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:08,178 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:08,202 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,202 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,203 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,203 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:08,203 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. started... 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:08,203 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,203 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:08,203 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 67f86c4e5660c65a51eeb0d4f16eb728 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:08,203 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. started... 2023-07-17 21:12:08,203 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:08,203 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:08,204 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3b67d9adc5d45b38ac2e34d2822e703d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 21:12:08,227 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307172fdc33da161a4b18895dff77fefe407f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307172fdc33da161a4b18895dff77fefe407f 2023-07-17 21:12:08,234 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717b7f87e0431a8401b80e659a0fdf5aec0 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717b7f87e0431a8401b80e659a0fdf5aec0 2023-07-17 21:12:08,258 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/.tmp/cf/c1773777455c4a11a8d6ab1dc8eabc29 2023-07-17 21:12:08,263 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:08,263 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,263 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:08,265 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/.tmp/cf/2b16461493c1487291f570bfc0ee4c67 2023-07-17 21:12:08,268 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/.tmp/cf/c1773777455c4a11a8d6ab1dc8eabc29 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf/c1773777455c4a11a8d6ab1dc8eabc29 2023-07-17 21:12:08,272 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/.tmp/cf/2b16461493c1487291f570bfc0ee4c67 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf/2b16461493c1487291f570bfc0ee4c67 2023-07-17 21:12:08,275 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf/c1773777455c4a11a8d6ab1dc8eabc29, entries=47, sequenceid=6, filesize=13.5 K 2023-07-17 21:12:08,276 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 67f86c4e5660c65a51eeb0d4f16eb728 in 73ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:08,277 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 21:12:08,277 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 67f86c4e5660c65a51eeb0d4f16eb728: 2023-07-17 21:12:08,278 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,278 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:08,278 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf/c1773777455c4a11a8d6ab1dc8eabc29] hfiles 2023-07-17 21:12:08,278 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf/c1773777455c4a11a8d6ab1dc8eabc29 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,281 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf/2b16461493c1487291f570bfc0ee4c67, entries=3, sequenceid=6, filesize=5.4 K 2023-07-17 21:12:08,282 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3b67d9adc5d45b38ac2e34d2822e703d in 78ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:08,288 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b67d9adc5d45b38ac2e34d2822e703d: 2023-07-17 21:12:08,288 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,288 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:08,288 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf/2b16461493c1487291f570bfc0ee4c67] hfiles 2023-07-17 21:12:08,288 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf/2b16461493c1487291f570bfc0ee4c67 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,295 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. completed. 2023-07-17 21:12:08,295 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:08,295 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:08,295 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:08,295 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,295 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:08,295 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. completed. 2023-07-17 21:12:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:08,381 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:08,381 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:08,381 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,381 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:08,381 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:08,385 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,386 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,386 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,386 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:08,447 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:08,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 21:12:08,456 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 21:12:08,456 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:08,456 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:08,456 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,456 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:08,478 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:08,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:08,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:08,479 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,663 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,663 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,664 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,665 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,666 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,667 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,667 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,747 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,747 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:12:08,748 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,750 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,750 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,750 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,750 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:08,750 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,750 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:08,751 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:08,751 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,751 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307172fdc33da161a4b18895dff77fefe407f, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717b7f87e0431a8401b80e659a0fdf5aec0] mob files 2023-07-17 21:12:08,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307172fdc33da161a4b18895dff77fefe407f 2023-07-17 21:12:08,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717b7f87e0431a8401b80e659a0fdf5aec0 2023-07-17 21:12:08,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,979 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:08,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:08,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:08,981 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-17 21:12:09,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:09,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 21:12:09,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:09,271 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:09,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689628327873Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689628328760 (+887 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328760Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328760Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328765 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689628329177 (+412 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689628329270 (+93 ms) 2023-07-17 21:12:09,274 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:09,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.3990 sec 2023-07-17 21:12:09,629 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0004_000001 (auth:SIMPLE) 2023-07-17 21:12:09,981 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:09,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:09,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:10,009 DEBUG [Listener at jenkins-hbase4.apache.org/43825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:12:10,015 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:12:10,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 21:12:10,017 DEBUG [Listener at jenkins-hbase4.apache.org/43825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:12:10,019 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:12:10,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 21:12:10,020 DEBUG [Listener at jenkins-hbase4.apache.org/43825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:12:10,023 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:12:10,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 21:12:10,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:12:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,028 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:10,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 21:12:10,029 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:10,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:10,031 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,031 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,032 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 empty. 2023-07-17 21:12:10,032 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f empty. 2023-07-17 21:12:10,032 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,032 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,032 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 21:12:10,042 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:10,044 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 748f2840c4c48a0dc9b2381d15c3380f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:10,044 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7334e1e5e2bbd8223e7f468cb0a80ad6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:10,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:10,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 748f2840c4c48a0dc9b2381d15c3380f, disabling compactions & flushes 2023-07-17 21:12:10,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. after waiting 0 ms 2023-07-17 21:12:10,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 748f2840c4c48a0dc9b2381d15c3380f: 2023-07-17 21:12:10,057 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:10,057 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 7334e1e5e2bbd8223e7f468cb0a80ad6, disabling compactions & flushes 2023-07-17 21:12:10,057 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,057 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,057 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. after waiting 0 ms 2023-07-17 21:12:10,057 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,057 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,057 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 7334e1e5e2bbd8223e7f468cb0a80ad6: 2023-07-17 21:12:10,059 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:10,060 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628330060"}]},"ts":"1689628330060"} 2023-07-17 21:12:10,060 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628330060"}]},"ts":"1689628330060"} 2023-07-17 21:12:10,063 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:10,063 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:10,063 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628330063"}]},"ts":"1689628330063"} 2023-07-17 21:12:10,065 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 21:12:10,068 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:10,069 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:10,069 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:10,069 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:10,069 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:10,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, ASSIGN}] 2023-07-17 21:12:10,071 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, ASSIGN 2023-07-17 21:12:10,072 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, ASSIGN 2023-07-17 21:12:10,073 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1689628244150; forceNewPlan=false, retain=false 2023-07-17 21:12:10,073 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1689628244095; forceNewPlan=false, retain=false 2023-07-17 21:12:10,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:10,223 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:10,226 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=748f2840c4c48a0dc9b2381d15c3380f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:10,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7334e1e5e2bbd8223e7f468cb0a80ad6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:10,226 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628330226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628330226"}]},"ts":"1689628330226"} 2023-07-17 21:12:10,226 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628330226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628330226"}]},"ts":"1689628330226"} 2023-07-17 21:12:10,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 748f2840c4c48a0dc9b2381d15c3380f, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:10,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 7334e1e5e2bbd8223e7f468cb0a80ad6, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:10,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:10,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 748f2840c4c48a0dc9b2381d15c3380f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 21:12:10,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7334e1e5e2bbd8223e7f468cb0a80ad6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 21:12:10,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. service=AccessControlService 2023-07-17 21:12:10,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:10,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:10,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. service=AccessControlService 2023-07-17 21:12:10,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:10,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:10,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,391 INFO [StoreOpener-748f2840c4c48a0dc9b2381d15c3380f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,391 INFO [StoreOpener-7334e1e5e2bbd8223e7f468cb0a80ad6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,393 DEBUG [StoreOpener-748f2840c4c48a0dc9b2381d15c3380f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf 2023-07-17 21:12:10,393 DEBUG [StoreOpener-748f2840c4c48a0dc9b2381d15c3380f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf 2023-07-17 21:12:10,393 DEBUG [StoreOpener-7334e1e5e2bbd8223e7f468cb0a80ad6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf 2023-07-17 21:12:10,393 DEBUG [StoreOpener-7334e1e5e2bbd8223e7f468cb0a80ad6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf 2023-07-17 21:12:10,393 INFO [StoreOpener-7334e1e5e2bbd8223e7f468cb0a80ad6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7334e1e5e2bbd8223e7f468cb0a80ad6 columnFamilyName cf 2023-07-17 21:12:10,393 INFO [StoreOpener-748f2840c4c48a0dc9b2381d15c3380f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 748f2840c4c48a0dc9b2381d15c3380f columnFamilyName cf 2023-07-17 21:12:10,394 INFO [StoreOpener-7334e1e5e2bbd8223e7f468cb0a80ad6-1] regionserver.HStore(310): Store=7334e1e5e2bbd8223e7f468cb0a80ad6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:10,394 INFO [StoreOpener-748f2840c4c48a0dc9b2381d15c3380f-1] regionserver.HStore(310): Store=748f2840c4c48a0dc9b2381d15c3380f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:10,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:10,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:10,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 748f2840c4c48a0dc9b2381d15c3380f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69146614, jitterRate=0.03036484122276306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:10,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7334e1e5e2bbd8223e7f468cb0a80ad6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68965456, jitterRate=0.027665376663208008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:10,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 748f2840c4c48a0dc9b2381d15c3380f: 2023-07-17 21:12:10,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7334e1e5e2bbd8223e7f468cb0a80ad6: 2023-07-17 21:12:10,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f., pid=69, masterSystemTime=1689628330383 2023-07-17 21:12:10,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6., pid=70, masterSystemTime=1689628330384 2023-07-17 21:12:10,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,417 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=748f2840c4c48a0dc9b2381d15c3380f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:10,417 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330417"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628330417"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628330417"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628330417"}]},"ts":"1689628330417"} 2023-07-17 21:12:10,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,418 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7334e1e5e2bbd8223e7f468cb0a80ad6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:10,418 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628330418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628330418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628330418"}]},"ts":"1689628330418"} 2023-07-17 21:12:10,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-17 21:12:10,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-17 21:12:10,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 748f2840c4c48a0dc9b2381d15c3380f, server=jenkins-hbase4.apache.org,39595,1689628244095 in 188 msec 2023-07-17 21:12:10,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 7334e1e5e2bbd8223e7f468cb0a80ad6, server=jenkins-hbase4.apache.org,44933,1689628244150 in 188 msec 2023-07-17 21:12:10,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, ASSIGN in 355 msec 2023-07-17 21:12:10,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-17 21:12:10,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, ASSIGN in 355 msec 2023-07-17 21:12:10,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:10,433 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628330433"}]},"ts":"1689628330433"} 2023-07-17 21:12:10,435 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 21:12:10,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:10,438 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 21:12:10,440 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 21:12:10,441 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:10,441 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:10,441 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:10,441 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:10,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 417 msec 2023-07-17 21:12:10,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:10,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:10,633 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 21:12:10,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 7334e1e5e2bbd8223e7f468cb0a80ad6, 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7334e1e5e2bbd8223e7f468cb0a80ad6, 748f2840c4c48a0dc9b2381d15c3380f], force=true 2023-07-17 21:12:10,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7334e1e5e2bbd8223e7f468cb0a80ad6, 748f2840c4c48a0dc9b2381d15c3380f], force=true 2023-07-17 21:12:10,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7334e1e5e2bbd8223e7f468cb0a80ad6, 748f2840c4c48a0dc9b2381d15c3380f], force=true 2023-07-17 21:12:10,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7334e1e5e2bbd8223e7f468cb0a80ad6, 748f2840c4c48a0dc9b2381d15c3380f], force=true 2023-07-17 21:12:10,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:10,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, UNASSIGN}] 2023-07-17 21:12:10,718 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, UNASSIGN 2023-07-17 21:12:10,718 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, UNASSIGN 2023-07-17 21:12:10,719 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=748f2840c4c48a0dc9b2381d15c3380f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:10,719 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7334e1e5e2bbd8223e7f468cb0a80ad6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:10,719 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628330719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628330719"}]},"ts":"1689628330719"} 2023-07-17 21:12:10,719 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628330719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628330719"}]},"ts":"1689628330719"} 2023-07-17 21:12:10,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 7334e1e5e2bbd8223e7f468cb0a80ad6, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:10,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 748f2840c4c48a0dc9b2381d15c3380f, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:10,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:10,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7334e1e5e2bbd8223e7f468cb0a80ad6, disabling compactions & flushes 2023-07-17 21:12:10,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. after waiting 0 ms 2023-07-17 21:12:10,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7334e1e5e2bbd8223e7f468cb0a80ad6 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 21:12:10,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 748f2840c4c48a0dc9b2381d15c3380f, disabling compactions & flushes 2023-07-17 21:12:10,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. after waiting 0 ms 2023-07-17 21:12:10,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 748f2840c4c48a0dc9b2381d15c3380f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 21:12:10,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/.tmp/cf/c8e8512931c2417b8ed6cc64446e32ef 2023-07-17 21:12:10,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/.tmp/cf/c8e8512931c2417b8ed6cc64446e32ef as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf/c8e8512931c2417b8ed6cc64446e32ef 2023-07-17 21:12:10,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/.tmp/cf/ade567ebdf5e4154aa6098c4dc6740ba 2023-07-17 21:12:10,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf/c8e8512931c2417b8ed6cc64446e32ef, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 21:12:10,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 748f2840c4c48a0dc9b2381d15c3380f in 44ms, sequenceid=5, compaction requested=false 2023-07-17 21:12:10,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 21:12:10,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/.tmp/cf/ade567ebdf5e4154aa6098c4dc6740ba as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf/ade567ebdf5e4154aa6098c4dc6740ba 2023-07-17 21:12:10,935 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:10,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf/ade567ebdf5e4154aa6098c4dc6740ba, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 21:12:10,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7334e1e5e2bbd8223e7f468cb0a80ad6 in 68ms, sequenceid=5, compaction requested=false 2023-07-17 21:12:10,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 21:12:10,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:10,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f. 2023-07-17 21:12:10,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 748f2840c4c48a0dc9b2381d15c3380f: 2023-07-17 21:12:10,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:10,951 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=748f2840c4c48a0dc9b2381d15c3380f, regionState=CLOSED 2023-07-17 21:12:10,951 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628330951"}]},"ts":"1689628330951"} 2023-07-17 21:12:10,956 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-17 21:12:10,956 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 748f2840c4c48a0dc9b2381d15c3380f, server=jenkins-hbase4.apache.org,39595,1689628244095 in 231 msec 2023-07-17 21:12:10,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=748f2840c4c48a0dc9b2381d15c3380f, UNASSIGN in 241 msec 2023-07-17 21:12:10,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:10,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 21:12:10,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:10,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6. 2023-07-17 21:12:10,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7334e1e5e2bbd8223e7f468cb0a80ad6: 2023-07-17 21:12:10,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:10,995 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7334e1e5e2bbd8223e7f468cb0a80ad6, regionState=CLOSED 2023-07-17 21:12:10,995 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628330995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628330995"}]},"ts":"1689628330995"} 2023-07-17 21:12:10,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-17 21:12:10,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 7334e1e5e2bbd8223e7f468cb0a80ad6, server=jenkins-hbase4.apache.org,44933,1689628244150 in 276 msec 2023-07-17 21:12:11,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-17 21:12:11,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7334e1e5e2bbd8223e7f468cb0a80ad6, UNASSIGN in 288 msec 2023-07-17 21:12:11,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:11,315 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 21:12:11,318 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330025.7334e1e5e2bbd8223e7f468cb0a80ad6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:11,318 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628330025.748f2840c4c48a0dc9b2381d15c3380f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:11,318 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:11,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, ASSIGN}] 2023-07-17 21:12:11,476 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, ASSIGN 2023-07-17 21:12:11,480 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44933,1689628244150; forceNewPlan=false, retain=false 2023-07-17 21:12:11,631 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 21:12:11,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=050e5e7eca3acdecb73dbdb76e4b5b48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:11,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628331633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628331633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628331633"}]},"ts":"1689628331633"} 2023-07-17 21:12:11,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 050e5e7eca3acdecb73dbdb76e4b5b48, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:11,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:11,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 050e5e7eca3acdecb73dbdb76e4b5b48, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:12:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. service=AccessControlService 2023-07-17 21:12:11,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/.regioninfo 2023-07-17 21:12:11,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:11,807 INFO [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,808 DEBUG [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf 2023-07-17 21:12:11,808 DEBUG [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf 2023-07-17 21:12:11,808 INFO [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 050e5e7eca3acdecb73dbdb76e4b5b48 columnFamilyName cf 2023-07-17 21:12:11,849 DEBUG [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] regionserver.HStore(539): loaded hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/ade567ebdf5e4154aa6098c4dc6740ba.7334e1e5e2bbd8223e7f468cb0a80ad6->hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf/ade567ebdf5e4154aa6098c4dc6740ba-top 2023-07-17 21:12:11,855 DEBUG [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] regionserver.HStore(539): loaded hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/c8e8512931c2417b8ed6cc64446e32ef.748f2840c4c48a0dc9b2381d15c3380f->hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf/c8e8512931c2417b8ed6cc64446e32ef-top 2023-07-17 21:12:11,856 INFO [StoreOpener-050e5e7eca3acdecb73dbdb76e4b5b48-1] regionserver.HStore(310): Store=050e5e7eca3acdecb73dbdb76e4b5b48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:11,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:11,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 050e5e7eca3acdecb73dbdb76e4b5b48; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64069925, jitterRate=-0.0452837198972702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:11,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 050e5e7eca3acdecb73dbdb76e4b5b48: 2023-07-17 21:12:11,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48., pid=77, masterSystemTime=1689628331787 2023-07-17 21:12:11,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.,because compaction is disabled. 2023-07-17 21:12:11,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:11,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:11,867 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=050e5e7eca3acdecb73dbdb76e4b5b48, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:11,867 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628331867"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628331867"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628331867"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628331867"}]},"ts":"1689628331867"} 2023-07-17 21:12:11,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 21:12:11,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 050e5e7eca3acdecb73dbdb76e4b5b48, server=jenkins-hbase4.apache.org,44933,1689628244150 in 234 msec 2023-07-17 21:12:11,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 21:12:11,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, ASSIGN in 397 msec 2023-07-17 21:12:11,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7334e1e5e2bbd8223e7f468cb0a80ad6, 748f2840c4c48a0dc9b2381d15c3380f], force=true in 1.2010 sec 2023-07-17 21:12:12,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:12,794 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 21:12:12,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 21:12:12,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628332795 (current time:1689628332795). 2023-07-17 21:12:12,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:12,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x6bdbb648 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:12,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b83b20d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:12,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:12,820 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:12,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bdbb648 to 127.0.0.1:60809 2023-07-17 21:12:12,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:12,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x1d5c1390 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b839f85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:12,927 DEBUG [hconnection-0x7d465322-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:12,932 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d5c1390 to 127.0.0.1:60809 2023-07-17 21:12:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 21:12:12,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:12,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 21:12:12,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 21:12:12,960 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 21:12:12,961 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689628932961 2023-07-17 21:12:12,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 21:12:12,967 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:12,967 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:12,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:12,974 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 21:12:12,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 21:12:12,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 19 msec 2023-07-17 21:12:12,977 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 21:12:12,978 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689628932978 2023-07-17 21:12:13,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,006 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 21:12:13,006 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:13,008 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 21:12:13,008 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 21:12:13,009 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,009 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,010 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:13,010 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:13,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:13,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:13,011 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:13,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:13,011 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,012 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,012 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:13,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 21:12:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 21:12:13,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,013 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 21:12:13,013 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:13,015 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 21:12:13,015 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 21:12:13,015 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 21:12:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 21:12:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 21:12:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,015 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 21:12:13,015 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 21:12:13,018 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,019 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,019 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:13,019 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 21:12:13,019 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:13,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,021 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 21:12:13,022 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 21:12:13,022 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:13,022 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 21:12:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 21:12:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 21:12:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 21:12:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 21:12:13,025 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,025 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:13,025 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,026 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,026 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:13,026 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,026 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:13,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 21:12:13,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45338cb3[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:13,029 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 21:12:13,029 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,030 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,030 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,030 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 21:12:13,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,031 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,031 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 21:12:13,031 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 21:12:13,031 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. started... 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:13,033 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 050e5e7eca3acdecb73dbdb76e4b5b48: 2023-07-17 21:12:13,033 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,033 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:13,033 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/ade567ebdf5e4154aa6098c4dc6740ba.7334e1e5e2bbd8223e7f468cb0a80ad6->hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf/ade567ebdf5e4154aa6098c4dc6740ba-top, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/c8e8512931c2417b8ed6cc64446e32ef.748f2840c4c48a0dc9b2381d15c3380f->hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf/c8e8512931c2417b8ed6cc64446e32ef-top] hfiles 2023-07-17 21:12:13,033 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/ade567ebdf5e4154aa6098c4dc6740ba.7334e1e5e2bbd8223e7f468cb0a80ad6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,034 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/c8e8512931c2417b8ed6cc64446e32ef.748f2840c4c48a0dc9b2381d15c3380f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,034 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 21:12:13,034 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:13,034 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 21:12:13,040 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 21:12:13,040 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:13,040 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 21:12:13,061 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. completed. 2023-07-17 21:12:13,061 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:13,061 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:13,061 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:13,061 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,062 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 21:12:13,062 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:13,067 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:13,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 21:12:13,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:13,068 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,068 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 21:12:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,069 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:13,069 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:13,069 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 21:12:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:13,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 21:12:13,073 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 21:12:13,073 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:13,073 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:13,073 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,073 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,075 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,076 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:13,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:13,077 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:13,077 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:13,081 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,081 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,081 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:13,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:13,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:13,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:13,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:13,085 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:13,085 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:13,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:13,085 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:13,087 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,087 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:13,087 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:13,087 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,087 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:13,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 21:12:13,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,180 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689628332970Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628333086 (+116 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628333086Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628333090 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628333111 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689628333179 (+68 ms) 2023-07-17 21:12:13,183 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 21:12:13,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 210 msec 2023-07-17 21:12:13,269 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 21:12:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:13,271 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270 2023-07-17 21:12:13,271 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34459, tgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270, rawTgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:12:13,301 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:12:13,301 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-139727849_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,301 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 21:12:13,313 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:13,366 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:13,367 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:13,367 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:13,368 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,485 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-1011376661683904730.jar 2023-07-17 21:12:14,486 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,486 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,567 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-2948587632055369038.jar 2023-07-17 21:12:14,568 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,568 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,569 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,570 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,570 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,571 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:14,571 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:12:14,572 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:12:14,572 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:12:14,573 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:12:14,573 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:12:14,574 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:12:14,575 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:12:14,575 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:12:14,576 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:12:14,577 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:12:14,577 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:14,578 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:14,578 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:14,579 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:14,579 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:14,580 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:14,581 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:15,892 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:16,254 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:12:16,259 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 21:12:16,261 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 21:12:16,752 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:16,752 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:17,542 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:23,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:26,330 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:29,862 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:30,923 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:12:30,928 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:12:30,942 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:30,942 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:12:30,942 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:12:30,943 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:30,943 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 21:12:30,943 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 21:12:30,943 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:30,944 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 21:12:30,944 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628333270/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 21:12:30,951 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:30,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:30,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:30,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 21:12:30,956 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628350956"}]},"ts":"1689628350956"} 2023-07-17 21:12:30,957 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 21:12:30,959 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 21:12:30,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, UNASSIGN}] 2023-07-17 21:12:30,961 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, UNASSIGN 2023-07-17 21:12:30,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=050e5e7eca3acdecb73dbdb76e4b5b48, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:30,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628350962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628350962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628350962"}]},"ts":"1689628350962"} 2023-07-17 21:12:30,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 050e5e7eca3acdecb73dbdb76e4b5b48, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:31,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 21:12:31,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:31,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 050e5e7eca3acdecb73dbdb76e4b5b48, disabling compactions & flushes 2023-07-17 21:12:31,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:31,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:31,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. after waiting 0 ms 2023-07-17 21:12:31,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:31,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 21:12:31,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:31,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48. 2023-07-17 21:12:31,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 050e5e7eca3acdecb73dbdb76e4b5b48: 2023-07-17 21:12:31,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:31,178 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=050e5e7eca3acdecb73dbdb76e4b5b48, regionState=CLOSED 2023-07-17 21:12:31,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628351178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628351178"}]},"ts":"1689628351178"} 2023-07-17 21:12:31,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 21:12:31,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 050e5e7eca3acdecb73dbdb76e4b5b48, server=jenkins-hbase4.apache.org,44933,1689628244150 in 227 msec 2023-07-17 21:12:31,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 21:12:31,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=050e5e7eca3acdecb73dbdb76e4b5b48, UNASSIGN in 233 msec 2023-07-17 21:12:31,195 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628351194"}]},"ts":"1689628351194"} 2023-07-17 21:12:31,196 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 21:12:31,198 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 21:12:31,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 247 msec 2023-07-17 21:12:31,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 21:12:31,259 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 21:12:31,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,271 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,272 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,278 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:31,279 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:31,278 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:31,279 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,279 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,280 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,280 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:31,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:31,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:31,280 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,282 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/recovered.edits] 2023-07-17 21:12:31,282 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,283 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:31,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:31,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 21:12:31,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:31,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:31,286 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/recovered.edits] 2023-07-17 21:12:31,287 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/recovered.edits] 2023-07-17 21:12:31,291 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf/c8e8512931c2417b8ed6cc64446e32ef to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/cf/c8e8512931c2417b8ed6cc64446e32ef 2023-07-17 21:12:31,294 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/ade567ebdf5e4154aa6098c4dc6740ba.7334e1e5e2bbd8223e7f468cb0a80ad6 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/ade567ebdf5e4154aa6098c4dc6740ba.7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:31,296 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/recovered.edits/8.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f/recovered.edits/8.seqid 2023-07-17 21:12:31,296 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:31,296 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/c8e8512931c2417b8ed6cc64446e32ef.748f2840c4c48a0dc9b2381d15c3380f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/cf/c8e8512931c2417b8ed6cc64446e32ef.748f2840c4c48a0dc9b2381d15c3380f 2023-07-17 21:12:31,298 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf/ade567ebdf5e4154aa6098c4dc6740ba to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/cf/ade567ebdf5e4154aa6098c4dc6740ba 2023-07-17 21:12:31,299 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/recovered.edits/12.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48/recovered.edits/12.seqid 2023-07-17 21:12:31,300 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/050e5e7eca3acdecb73dbdb76e4b5b48 2023-07-17 21:12:31,302 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/recovered.edits/8.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6/recovered.edits/8.seqid 2023-07-17 21:12:31,302 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7334e1e5e2bbd8223e7f468cb0a80ad6 2023-07-17 21:12:31,302 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 21:12:31,305 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,312 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 21:12:31,318 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 21:12:31,323 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,323 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 21:12:31,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628351323"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:31,327 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 21:12:31,327 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 050e5e7eca3acdecb73dbdb76e4b5b48, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628330026.050e5e7eca3acdecb73dbdb76e4b5b48.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 21:12:31,327 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 21:12:31,327 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628351327"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:31,332 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 21:12:31,334 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 74 msec 2023-07-17 21:12:31,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 21:12:31,385 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 21:12:31,386 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 21:12:31,392 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628351391"}]},"ts":"1689628351391"} 2023-07-17 21:12:31,393 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 21:12:31,395 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 21:12:31,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, UNASSIGN}] 2023-07-17 21:12:31,398 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, UNASSIGN 2023-07-17 21:12:31,398 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, UNASSIGN 2023-07-17 21:12:31,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3b67d9adc5d45b38ac2e34d2822e703d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:31,400 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=67f86c4e5660c65a51eeb0d4f16eb728, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:31,400 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628351400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628351400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628351400"}]},"ts":"1689628351400"} 2023-07-17 21:12:31,400 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628351400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628351400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628351400"}]},"ts":"1689628351400"} 2023-07-17 21:12:31,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 67f86c4e5660c65a51eeb0d4f16eb728, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:31,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 3b67d9adc5d45b38ac2e34d2822e703d, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:31,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 21:12:31,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:31,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 67f86c4e5660c65a51eeb0d4f16eb728, disabling compactions & flushes 2023-07-17 21:12:31,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:31,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:31,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. after waiting 0 ms 2023-07-17 21:12:31,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:31,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:31,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b67d9adc5d45b38ac2e34d2822e703d, disabling compactions & flushes 2023-07-17 21:12:31,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:31,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:31,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. after waiting 0 ms 2023-07-17 21:12:31,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:31,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:31,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:31,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d. 2023-07-17 21:12:31,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b67d9adc5d45b38ac2e34d2822e703d: 2023-07-17 21:12:31,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:31,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:31,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:31,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728. 2023-07-17 21:12:31,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 67f86c4e5660c65a51eeb0d4f16eb728: 2023-07-17 21:12:31,580 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3b67d9adc5d45b38ac2e34d2822e703d, regionState=CLOSED 2023-07-17 21:12:31,580 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628351580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628351580"}]},"ts":"1689628351580"} 2023-07-17 21:12:31,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:31,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=67f86c4e5660c65a51eeb0d4f16eb728, regionState=CLOSED 2023-07-17 21:12:31,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628351583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628351583"}]},"ts":"1689628351583"} 2023-07-17 21:12:31,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-17 21:12:31,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 3b67d9adc5d45b38ac2e34d2822e703d, server=jenkins-hbase4.apache.org,44933,1689628244150 in 179 msec 2023-07-17 21:12:31,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3b67d9adc5d45b38ac2e34d2822e703d, UNASSIGN in 188 msec 2023-07-17 21:12:31,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-17 21:12:31,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 67f86c4e5660c65a51eeb0d4f16eb728, server=jenkins-hbase4.apache.org,39595,1689628244095 in 186 msec 2023-07-17 21:12:31,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-17 21:12:31,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=67f86c4e5660c65a51eeb0d4f16eb728, UNASSIGN in 196 msec 2023-07-17 21:12:31,596 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628351596"}]},"ts":"1689628351596"} 2023-07-17 21:12:31,602 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 21:12:31,605 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 21:12:31,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 220 msec 2023-07-17 21:12:31,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 21:12:31,694 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 21:12:31,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,700 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,701 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,702 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,705 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,705 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,705 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,706 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,710 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:31,710 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:31,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 21:12:31,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 21:12:31,712 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,712 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-17 21:12:31,712 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:12:31,712 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,712 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,712 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-17 21:12:31,712 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:12:31,712 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,712 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,713 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:31,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 21:12:31,714 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/recovered.edits] 2023-07-17 21:12:31,714 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/recovered.edits] 2023-07-17 21:12:31,730 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf/2b16461493c1487291f570bfc0ee4c67 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/cf/2b16461493c1487291f570bfc0ee4c67 2023-07-17 21:12:31,731 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf/c1773777455c4a11a8d6ab1dc8eabc29 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/cf/c1773777455c4a11a8d6ab1dc8eabc29 2023-07-17 21:12:31,734 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d/recovered.edits/9.seqid 2023-07-17 21:12:31,735 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3b67d9adc5d45b38ac2e34d2822e703d 2023-07-17 21:12:31,736 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728/recovered.edits/9.seqid 2023-07-17 21:12:31,736 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/67f86c4e5660c65a51eeb0d4f16eb728 2023-07-17 21:12:31,736 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 21:12:31,737 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-17 21:12:31,738 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-17 21:12:31,743 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307172fdc33da161a4b18895dff77fefe407f to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307172fdc33da161a4b18895dff77fefe407f 2023-07-17 21:12:31,744 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717b7f87e0431a8401b80e659a0fdf5aec0 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717b7f87e0431a8401b80e659a0fdf5aec0 2023-07-17 21:12:31,745 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-17 21:12:31,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,753 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 21:12:31,755 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 21:12:31,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 21:12:31,758 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628351757"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:31,758 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628351757"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:31,761 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:12:31,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3b67d9adc5d45b38ac2e34d2822e703d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325642.3b67d9adc5d45b38ac2e34d2822e703d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 67f86c4e5660c65a51eeb0d4f16eb728, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325642.67f86c4e5660c65a51eeb0d4f16eb728.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:12:31,761 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 21:12:31,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628351761"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:31,763 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 21:12:31,765 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 71 msec 2023-07-17 21:12:31,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 21:12:31,815 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 21:12:31,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 21:12:31,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 21:12:31,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:31,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 21:12:31,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:31,876 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=755 (was 746) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3989 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:39372 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:34219 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:53980 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:45542 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2006253508_1 at /127.0.0.1:33470 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 891) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=629 (was 416) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 185), AvailableMemoryMB=2702 (was 2970) 2023-07-17 21:12:31,876 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-17 21:12:31,907 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=755, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=629, ProcessCount=184, AvailableMemoryMB=2686 2023-07-17 21:12:31,907 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-17 21:12:31,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 21:12:31,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:31,913 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:31,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 21:12:31,914 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:31,917 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:31,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:31,917 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:31,919 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 empty. 2023-07-17 21:12:31,919 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 empty. 2023-07-17 21:12:31,920 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:31,920 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:31,920 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 21:12:31,968 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:31,971 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 320fac863e9a87bae16014eb18d283b8, NAME => 'testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:31,976 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c332f3245c1d6a6379d33a4827daec18, NAME => 'testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:32,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:32,074 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:32,074 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 320fac863e9a87bae16014eb18d283b8, disabling compactions & flushes 2023-07-17 21:12:32,074 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,074 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,074 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. after waiting 0 ms 2023-07-17 21:12:32,074 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,074 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,074 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 320fac863e9a87bae16014eb18d283b8: 2023-07-17 21:12:32,075 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:32,075 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c332f3245c1d6a6379d33a4827daec18, disabling compactions & flushes 2023-07-17 21:12:32,075 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,075 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,075 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. after waiting 0 ms 2023-07-17 21:12:32,075 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,075 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,075 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c332f3245c1d6a6379d33a4827daec18: 2023-07-17 21:12:32,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:32,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628352079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628352079"}]},"ts":"1689628352079"} 2023-07-17 21:12:32,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628352079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628352079"}]},"ts":"1689628352079"} 2023-07-17 21:12:32,084 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:32,085 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:32,085 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628352085"}]},"ts":"1689628352085"} 2023-07-17 21:12:32,087 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 21:12:32,091 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:32,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:32,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:32,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:32,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:32,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, ASSIGN}] 2023-07-17 21:12:32,096 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, ASSIGN 2023-07-17 21:12:32,096 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, ASSIGN 2023-07-17 21:12:32,098 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1689628244150; forceNewPlan=false, retain=false 2023-07-17 21:12:32,098 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39595,1689628244095; forceNewPlan=false, retain=false 2023-07-17 21:12:32,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:32,249 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:32,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c332f3245c1d6a6379d33a4827daec18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=320fac863e9a87bae16014eb18d283b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,253 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628352252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628352252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628352252"}]},"ts":"1689628352252"} 2023-07-17 21:12:32,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628352252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628352252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628352252"}]},"ts":"1689628352252"} 2023-07-17 21:12:32,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 320fac863e9a87bae16014eb18d283b8, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:32,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c332f3245c1d6a6379d33a4827daec18, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:32,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 320fac863e9a87bae16014eb18d283b8, NAME => 'testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:12:32,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c332f3245c1d6a6379d33a4827daec18, NAME => 'testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. service=AccessControlService 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. service=AccessControlService 2023-07-17 21:12:32,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:32,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:32,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,419 INFO [StoreOpener-c332f3245c1d6a6379d33a4827daec18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,422 INFO [StoreOpener-320fac863e9a87bae16014eb18d283b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,422 DEBUG [StoreOpener-c332f3245c1d6a6379d33a4827daec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf 2023-07-17 21:12:32,422 DEBUG [StoreOpener-c332f3245c1d6a6379d33a4827daec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf 2023-07-17 21:12:32,423 INFO [StoreOpener-c332f3245c1d6a6379d33a4827daec18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c332f3245c1d6a6379d33a4827daec18 columnFamilyName cf 2023-07-17 21:12:32,424 DEBUG [StoreOpener-320fac863e9a87bae16014eb18d283b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf 2023-07-17 21:12:32,424 DEBUG [StoreOpener-320fac863e9a87bae16014eb18d283b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf 2023-07-17 21:12:32,424 INFO [StoreOpener-320fac863e9a87bae16014eb18d283b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 320fac863e9a87bae16014eb18d283b8 columnFamilyName cf 2023-07-17 21:12:32,425 INFO [StoreOpener-c332f3245c1d6a6379d33a4827daec18-1] regionserver.HStore(310): Store=c332f3245c1d6a6379d33a4827daec18/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:32,426 INFO [StoreOpener-320fac863e9a87bae16014eb18d283b8-1] regionserver.HStore(310): Store=320fac863e9a87bae16014eb18d283b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:32,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:32,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:32,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c332f3245c1d6a6379d33a4827daec18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72308114, jitterRate=0.07747486233711243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:32,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c332f3245c1d6a6379d33a4827daec18: 2023-07-17 21:12:32,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:32,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18., pid=94, masterSystemTime=1689628352409 2023-07-17 21:12:32,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:32,438 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c332f3245c1d6a6379d33a4827daec18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,438 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628352437"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628352437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628352437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628352437"}]},"ts":"1689628352437"} 2023-07-17 21:12:32,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 320fac863e9a87bae16014eb18d283b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64291797, jitterRate=-0.041977569460868835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:32,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 320fac863e9a87bae16014eb18d283b8: 2023-07-17 21:12:32,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8., pid=93, masterSystemTime=1689628352409 2023-07-17 21:12:32,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,441 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=320fac863e9a87bae16014eb18d283b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,441 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628352441"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628352441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628352441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628352441"}]},"ts":"1689628352441"} 2023-07-17 21:12:32,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-17 21:12:32,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c332f3245c1d6a6379d33a4827daec18, server=jenkins-hbase4.apache.org,44933,1689628244150 in 183 msec 2023-07-17 21:12:32,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, ASSIGN in 348 msec 2023-07-17 21:12:32,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-17 21:12:32,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 320fac863e9a87bae16014eb18d283b8, server=jenkins-hbase4.apache.org,39595,1689628244095 in 188 msec 2023-07-17 21:12:32,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-17 21:12:32,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, ASSIGN in 352 msec 2023-07-17 21:12:32,447 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:32,447 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628352447"}]},"ts":"1689628352447"} 2023-07-17 21:12:32,449 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 21:12:32,451 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:32,451 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 21:12:32,453 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:12:32,459 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:32,459 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:32,459 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:32,459 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:32,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:32,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:32,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:32,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:32,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 552 msec 2023-07-17 21:12:32,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:32,531 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 21:12:32,533 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:32,533 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,536 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:32,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628352603 (current time:1689628352603). 2023-07-17 21:12:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x04b8fb34 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:32,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e659ff0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:32,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:32,622 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:32,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04b8fb34 to 127.0.0.1:60809 2023-07-17 21:12:32,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:32,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x4af95c22 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:32,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95b7f12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:32,640 DEBUG [hconnection-0x1bd3fbd6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:32,641 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:32,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af95c22 to 127.0.0.1:60809 2023-07-17 21:12:32,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:32,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:12:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:32,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:32,656 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:32,656 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628952656 2023-07-17 21:12:32,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:32,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:32,658 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:32,658 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:32,660 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:32,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:32,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-17 21:12:32,666 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:32,672 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628952672 2023-07-17 21:12:32,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,685 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 21:12:32,685 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:32,689 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 21:12:32,689 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:12:32,690 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,690 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,698 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:32,698 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:32,698 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:32,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:32,699 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:32,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,699 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,699 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,700 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,700 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:32,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:32,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:32,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:32,708 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:32,708 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:32,708 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:32,711 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,711 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,711 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,711 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:32,711 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:32,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:32,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:32,717 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:12:32,717 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,718 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,718 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,719 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:32,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,719 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,719 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:32,719 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,719 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,719 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:32,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,720 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:32,720 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:32,720 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:32,721 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,722 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:32,722 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:32,722 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. started... 2023-07-17 21:12:32,722 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,722 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. started... 2023-07-17 21:12:32,722 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 320fac863e9a87bae16014eb18d283b8: 2023-07-17 21:12:32,724 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:32,724 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c332f3245c1d6a6379d33a4827daec18: 2023-07-17 21:12:32,724 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:32,724 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,725 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,724 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:32,725 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:32,725 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:32,725 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:32,725 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:32,753 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. completed. 2023-07-17 21:12:32,754 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:32,754 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:32,756 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:32,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,758 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:32,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,759 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:32,759 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:32,759 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:32,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,761 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. completed. 2023-07-17 21:12:32,761 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:32,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:32,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:32,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:32,762 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:32,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,764 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:32,764 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:32,764 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:32,766 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:12:32,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:12:32,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:32,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:32,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:32,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:32,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:32,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:32,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:12:32,772 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 21:12:32,772 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:32,772 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:32,772 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,772 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:32,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:32,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,774 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,775 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:32,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,776 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:32,777 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:32,779 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,779 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,780 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,787 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:32,787 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:32,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:32,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:32,788 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:32,787 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:32,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:32,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:32,791 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:32,788 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:32,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:32,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:32,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:32,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:32,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:12:32,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 21:12:32,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 21:12:32,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,941 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:32,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689628352656Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689628352812 (+156 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689628352812Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689628352812Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689628352819 (+7 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689628352857 (+38 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689628352932 (+75 ms) 2023-07-17 21:12:32,946 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:32,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 288 msec 2023-07-17 21:12:32,962 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:32,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:32,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:32,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:32,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39595] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:32,971 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:32,971 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:32,971 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:32,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:32,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628352986 (current time:1689628352986). 2023-07-17 21:12:32,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:32,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x2615ba20 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:33,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229cf87f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:33,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:33,015 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:33,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2615ba20 to 127.0.0.1:60809 2023-07-17 21:12:33,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:33,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x6011f7f3 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:33,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b5e856b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:33,044 DEBUG [hconnection-0x2e44c77f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:33,048 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:33,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6011f7f3 to 127.0.0.1:60809 2023-07-17 21:12:33,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:33,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:12:33,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:33,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:33,069 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:33,070 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628953070 2023-07-17 21:12:33,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:33,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:33,070 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:33,070 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:33,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:33,076 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:33,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-17 21:12:33,081 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:33,082 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628953082 2023-07-17 21:12:33,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,143 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 21:12:33,143 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:33,144 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 21:12:33,144 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:12:33,145 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,145 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,146 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:33,146 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:33,146 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,146 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:33,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:33,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:33,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:33,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:33,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:33,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:33,147 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,147 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,152 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,152 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:33,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 21:12:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 21:12:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,160 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:33,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 21:12:33,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,161 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:33,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,163 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:33,163 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:33,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:33,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,171 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,171 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,172 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,173 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:33,174 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,174 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:33,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:33,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:33,178 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:12:33,178 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,182 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,182 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,182 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:33,183 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,187 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:33,187 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:33,187 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:33,187 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:33,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,188 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:33,188 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,188 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,188 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:33,191 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:33,191 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:33,191 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:33,191 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. started... 2023-07-17 21:12:33,191 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c332f3245c1d6a6379d33a4827daec18 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-17 21:12:33,193 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:33,197 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:33,197 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:33,197 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:33,201 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:33,201 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. started... 2023-07-17 21:12:33,202 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 320fac863e9a87bae16014eb18d283b8 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-17 21:12:33,251 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230717d76dfdb0aa0349d3af49f4f5b4fbbfe1 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717d76dfdb0aa0349d3af49f4f5b4fbbfe1 2023-07-17 21:12:33,320 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/.tmp/cf/9045f068d40e4bdf8747219839dbe104 2023-07-17 21:12:33,322 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071720f2d2ae6e9548a68cabb72357e8271e to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071720f2d2ae6e9548a68cabb72357e8271e 2023-07-17 21:12:33,328 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/.tmp/cf/9045f068d40e4bdf8747219839dbe104 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf/9045f068d40e4bdf8747219839dbe104 2023-07-17 21:12:33,333 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf/9045f068d40e4bdf8747219839dbe104, entries=44, sequenceid=6, filesize=12.6 K 2023-07-17 21:12:33,334 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for c332f3245c1d6a6379d33a4827daec18 in 143ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:33,335 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 21:12:33,335 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c332f3245c1d6a6379d33a4827daec18: 2023-07-17 21:12:33,335 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,336 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:33,336 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf/9045f068d40e4bdf8747219839dbe104] hfiles 2023-07-17 21:12:33,336 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf/9045f068d40e4bdf8747219839dbe104 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,361 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/.tmp/cf/fad87a15c7104d5cae961ec48d81cfbb 2023-07-17 21:12:33,365 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. completed. 2023-07-17 21:12:33,365 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:33,367 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:33,367 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:33,367 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,367 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:33,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:33,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:12:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:33,376 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/.tmp/cf/fad87a15c7104d5cae961ec48d81cfbb as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf/fad87a15c7104d5cae961ec48d81cfbb 2023-07-17 21:12:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:33,385 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf/fad87a15c7104d5cae961ec48d81cfbb, entries=6, sequenceid=6, filesize=5.9 K 2023-07-17 21:12:33,386 INFO [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 320fac863e9a87bae16014eb18d283b8 in 184ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:33,389 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 320fac863e9a87bae16014eb18d283b8: 2023-07-17 21:12:33,389 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,389 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:33,389 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf/fad87a15c7104d5cae961ec48d81cfbb] hfiles 2023-07-17 21:12:33,389 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf/fad87a15c7104d5cae961ec48d81cfbb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,424 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. completed. 2023-07-17 21:12:33,424 DEBUG [rs(jenkins-hbase4.apache.org,39595,1689628244095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:33,424 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:33,424 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:33,424 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,424 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:33,424 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:33,426 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:33,426 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,426 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,426 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39595,1689628244095': 2023-07-17 21:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:12:33,439 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 21:12:33,439 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:33,439 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:33,439 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,439 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,443 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:33,444 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,450 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:33,451 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:33,454 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,454 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,455 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,461 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:33,461 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:33,461 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:33,461 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,461 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:33,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:33,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:33,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:33,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,463 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:33,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:33,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:33,463 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:33,465 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:33,465 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,465 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:33,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:12:33,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717d76dfdb0aa0349d3af49f4f5b4fbbfe1, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071720f2d2ae6e9548a68cabb72357e8271e] mob files 2023-07-17 21:12:33,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717d76dfdb0aa0349d3af49f4f5b4fbbfe1 2023-07-17 21:12:33,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071720f2d2ae6e9548a68cabb72357e8271e 2023-07-17 21:12:33,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 21:12:33,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,656 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689628353070Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689628353494 (+424 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689628353494Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689628353495 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689628353500 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689628353549 (+49 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689628353656 (+107 ms) 2023-07-17 21:12:33,662 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:33,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 590 msec 2023-07-17 21:12:33,676 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:33,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:33,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:33,677 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677 2023-07-17 21:12:33,678 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34459, tgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677, rawTgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:12:33,702 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:12:33,702 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2049609912_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:33,703 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 21:12:33,712 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:34,138 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:34,138 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:34,139 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:34,139 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,321 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-3998774468899748750.jar 2023-07-17 21:12:35,322 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,420 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-4691849112565281366.jar 2023-07-17 21:12:35,420 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,421 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,421 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,422 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,423 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,423 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:35,424 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:12:35,424 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:12:35,425 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:12:35,425 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:12:35,426 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:12:35,427 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:12:35,427 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:12:35,428 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:12:35,428 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:12:35,429 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:12:35,430 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:35,430 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:35,431 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:35,432 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:35,432 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:35,433 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:35,433 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:36,001 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:36,860 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:37,202 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:12:37,213 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 21:12:37,389 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:37,390 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:37,649 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0006_000001 (auth:SIMPLE) 2023-07-17 21:12:43,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0006_000001 (auth:SIMPLE) 2023-07-17 21:12:46,716 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:12:46,717 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:12:46,754 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:46,754 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:12:46,759 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:12:46,759 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:46,759 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 21:12:46,760 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 21:12:46,760 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:46,760 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 21:12:46,760 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628353677/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 21:12:46,773 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 21:12:46,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 21:12:46,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:46,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 21:12:46,779 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628366779"}]},"ts":"1689628366779"} 2023-07-17 21:12:46,780 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 21:12:46,782 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 21:12:46,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, UNASSIGN}] 2023-07-17 21:12:46,785 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, UNASSIGN 2023-07-17 21:12:46,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, UNASSIGN 2023-07-17 21:12:46,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=320fac863e9a87bae16014eb18d283b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:46,787 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c332f3245c1d6a6379d33a4827daec18, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:46,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628366787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628366787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628366787"}]},"ts":"1689628366787"} 2023-07-17 21:12:46,787 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628366787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628366787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628366787"}]},"ts":"1689628366787"} 2023-07-17 21:12:46,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure c332f3245c1d6a6379d33a4827daec18, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:46,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 320fac863e9a87bae16014eb18d283b8, server=jenkins-hbase4.apache.org,39595,1689628244095}] 2023-07-17 21:12:46,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 21:12:46,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:46,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c332f3245c1d6a6379d33a4827daec18, disabling compactions & flushes 2023-07-17 21:12:46,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:46,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:46,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. after waiting 0 ms 2023-07-17 21:12:46,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:46,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:46,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 320fac863e9a87bae16014eb18d283b8, disabling compactions & flushes 2023-07-17 21:12:46,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:46,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:46,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. after waiting 0 ms 2023-07-17 21:12:46,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:46,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:46,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:46,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:46,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18. 2023-07-17 21:12:46,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c332f3245c1d6a6379d33a4827daec18: 2023-07-17 21:12:46,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:46,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8. 2023-07-17 21:12:46,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 320fac863e9a87bae16014eb18d283b8: 2023-07-17 21:12:46,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:46,980 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c332f3245c1d6a6379d33a4827daec18, regionState=CLOSED 2023-07-17 21:12:46,980 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628366980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628366980"}]},"ts":"1689628366980"} 2023-07-17 21:12:46,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:46,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=320fac863e9a87bae16014eb18d283b8, regionState=CLOSED 2023-07-17 21:12:46,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628366984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628366984"}]},"ts":"1689628366984"} 2023-07-17 21:12:46,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-17 21:12:46,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure c332f3245c1d6a6379d33a4827daec18, server=jenkins-hbase4.apache.org,44933,1689628244150 in 196 msec 2023-07-17 21:12:46,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-17 21:12:46,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c332f3245c1d6a6379d33a4827daec18, UNASSIGN in 205 msec 2023-07-17 21:12:46,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 320fac863e9a87bae16014eb18d283b8, server=jenkins-hbase4.apache.org,39595,1689628244095 in 197 msec 2023-07-17 21:12:47,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-17 21:12:47,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=320fac863e9a87bae16014eb18d283b8, UNASSIGN in 207 msec 2023-07-17 21:12:47,000 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628367000"}]},"ts":"1689628367000"} 2023-07-17 21:12:47,002 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 21:12:47,004 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 21:12:47,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 230 msec 2023-07-17 21:12:47,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 21:12:47,081 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 21:12:47,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,086 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,087 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,095 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:47,095 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:47,095 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,098 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/recovered.edits] 2023-07-17 21:12:47,098 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/recovered.edits] 2023-07-17 21:12:47,099 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,099 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,099 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,100 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,100 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:47,100 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:47,100 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:47,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-17 21:12:47,101 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,101 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 21:12:47,105 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf/9045f068d40e4bdf8747219839dbe104 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/cf/9045f068d40e4bdf8747219839dbe104 2023-07-17 21:12:47,106 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf/fad87a15c7104d5cae961ec48d81cfbb to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/cf/fad87a15c7104d5cae961ec48d81cfbb 2023-07-17 21:12:47,108 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18/recovered.edits/9.seqid 2023-07-17 21:12:47,109 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/c332f3245c1d6a6379d33a4827daec18 2023-07-17 21:12:47,110 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8/recovered.edits/9.seqid 2023-07-17 21:12:47,111 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testEmptyExportFileSystemState/320fac863e9a87bae16014eb18d283b8 2023-07-17 21:12:47,111 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 21:12:47,112 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-17 21:12:47,112 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-17 21:12:47,116 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717d76dfdb0aa0349d3af49f4f5b4fbbfe1 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717d76dfdb0aa0349d3af49f4f5b4fbbfe1 2023-07-17 21:12:47,118 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071720f2d2ae6e9548a68cabb72357e8271e to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071720f2d2ae6e9548a68cabb72357e8271e 2023-07-17 21:12:47,118 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-17 21:12:47,121 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,123 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 21:12:47,125 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 21:12:47,127 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,127 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 21:12:47,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628367127"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:47,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628367127"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:47,129 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:12:47,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 320fac863e9a87bae16014eb18d283b8, NAME => 'testtb-testEmptyExportFileSystemState,,1689628351909.320fac863e9a87bae16014eb18d283b8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c332f3245c1d6a6379d33a4827daec18, NAME => 'testtb-testEmptyExportFileSystemState,1,1689628351909.c332f3245c1d6a6379d33a4827daec18.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:12:47,129 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 21:12:47,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628367129"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:47,131 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 21:12:47,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:47,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 51 msec 2023-07-17 21:12:47,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 21:12:47,204 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 21:12:47,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 21:12:47,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:47,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 21:12:47,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:47,249 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2049609912_17 at /127.0.0.1:36044 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:51726 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:43825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_778848440_1 at /127.0.0.1:51690 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_778848440_1 at /127.0.0.1:51408 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:38197 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4676 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_555129325_17 at /127.0.0.1:51418 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1915fb1c-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1989499832) connection to jenkins-hbase4.apache.org/172.31.14.131:40087 from appattempt_1689628253218_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=921 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=671 (was 629) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 184), AvailableMemoryMB=2071 (was 2686) 2023-07-17 21:12:47,250 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-17 21:12:47,278 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=671, ProcessCount=183, AvailableMemoryMB=2071 2023-07-17 21:12:47,278 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-17 21:12:47,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 21:12:47,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:47,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:47,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 21:12:47,288 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:47,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:47,290 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,290 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 2023-07-17 21:12:47,291 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 empty. 2023-07-17 21:12:47,291 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 empty. 2023-07-17 21:12:47,291 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,291 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 2023-07-17 21:12:47,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 21:12:47,302 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:47,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => b9ddf003cf091d6438d37a1b5d86ff66, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:47,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 444116285094382bbceb792594982921, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp 2023-07-17 21:12:47,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:47,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:47,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 444116285094382bbceb792594982921, disabling compactions & flushes 2023-07-17 21:12:47,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing b9ddf003cf091d6438d37a1b5d86ff66, disabling compactions & flushes 2023-07-17 21:12:47,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. after waiting 0 ms 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. after waiting 0 ms 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 444116285094382bbceb792594982921: 2023-07-17 21:12:47,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for b9ddf003cf091d6438d37a1b5d86ff66: 2023-07-17 21:12:47,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:47,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628367332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628367332"}]},"ts":"1689628367332"} 2023-07-17 21:12:47,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628367332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628367332"}]},"ts":"1689628367332"} 2023-07-17 21:12:47,334 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:47,336 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:47,336 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628367336"}]},"ts":"1689628367336"} 2023-07-17 21:12:47,337 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 21:12:47,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:47,344 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:47,344 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:47,344 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:47,344 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:47,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, ASSIGN}] 2023-07-17 21:12:47,347 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, ASSIGN 2023-07-17 21:12:47,347 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, ASSIGN 2023-07-17 21:12:47,351 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46043,1689628244012; forceNewPlan=false, retain=false 2023-07-17 21:12:47,351 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1689628244150; forceNewPlan=false, retain=false 2023-07-17 21:12:47,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:47,501 INFO [jenkins-hbase4:33275] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:47,505 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=444116285094382bbceb792594982921, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:47,505 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b9ddf003cf091d6438d37a1b5d86ff66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:47,505 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628367505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628367505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628367505"}]},"ts":"1689628367505"} 2023-07-17 21:12:47,505 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628367505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628367505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628367505"}]},"ts":"1689628367505"} 2023-07-17 21:12:47,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 444116285094382bbceb792594982921, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:12:47,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure b9ddf003cf091d6438d37a1b5d86ff66, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:12:47,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:47,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 444116285094382bbceb792594982921, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:12:47,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. service=AccessControlService 2023-07-17 21:12:47,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:47,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 444116285094382bbceb792594982921 2023-07-17 21:12:47,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:47,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 444116285094382bbceb792594982921 2023-07-17 21:12:47,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 444116285094382bbceb792594982921 2023-07-17 21:12:47,675 INFO [StoreOpener-444116285094382bbceb792594982921-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 444116285094382bbceb792594982921 2023-07-17 21:12:47,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9ddf003cf091d6438d37a1b5d86ff66, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:12:47,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. service=AccessControlService 2023-07-17 21:12:47,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:47,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:47,677 DEBUG [StoreOpener-444116285094382bbceb792594982921-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf 2023-07-17 21:12:47,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,677 DEBUG [StoreOpener-444116285094382bbceb792594982921-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf 2023-07-17 21:12:47,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,677 INFO [StoreOpener-444116285094382bbceb792594982921-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 444116285094382bbceb792594982921 columnFamilyName cf 2023-07-17 21:12:47,679 INFO [StoreOpener-b9ddf003cf091d6438d37a1b5d86ff66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,682 INFO [StoreOpener-444116285094382bbceb792594982921-1] regionserver.HStore(310): Store=444116285094382bbceb792594982921/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:47,682 DEBUG [StoreOpener-b9ddf003cf091d6438d37a1b5d86ff66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf 2023-07-17 21:12:47,682 DEBUG [StoreOpener-b9ddf003cf091d6438d37a1b5d86ff66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf 2023-07-17 21:12:47,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 2023-07-17 21:12:47,683 INFO [StoreOpener-b9ddf003cf091d6438d37a1b5d86ff66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9ddf003cf091d6438d37a1b5d86ff66 columnFamilyName cf 2023-07-17 21:12:47,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 2023-07-17 21:12:47,684 INFO [StoreOpener-b9ddf003cf091d6438d37a1b5d86ff66-1] regionserver.HStore(310): Store=b9ddf003cf091d6438d37a1b5d86ff66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:47,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 444116285094382bbceb792594982921 2023-07-17 21:12:47,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:12:47,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:47,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 444116285094382bbceb792594982921; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64595433, jitterRate=-0.03745304048061371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:47,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 444116285094382bbceb792594982921: 2023-07-17 21:12:47,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921., pid=108, masterSystemTime=1689628367659 2023-07-17 21:12:47,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=444116285094382bbceb792594982921, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:47,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628367696"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628367696"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628367696"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628367696"}]},"ts":"1689628367696"} 2023-07-17 21:12:47,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:47,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-17 21:12:47,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 444116285094382bbceb792594982921, server=jenkins-hbase4.apache.org,44933,1689628244150 in 192 msec 2023-07-17 21:12:47,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, ASSIGN in 359 msec 2023-07-17 21:12:47,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:47,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b9ddf003cf091d6438d37a1b5d86ff66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68364579, jitterRate=0.01871161162853241}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:47,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b9ddf003cf091d6438d37a1b5d86ff66: 2023-07-17 21:12:47,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66., pid=109, masterSystemTime=1689628367661 2023-07-17 21:12:47,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,711 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b9ddf003cf091d6438d37a1b5d86ff66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:47,712 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628367711"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628367711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628367711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628367711"}]},"ts":"1689628367711"} 2023-07-17 21:12:47,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-17 21:12:47,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure b9ddf003cf091d6438d37a1b5d86ff66, server=jenkins-hbase4.apache.org,46043,1689628244012 in 206 msec 2023-07-17 21:12:47,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-17 21:12:47,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, ASSIGN in 375 msec 2023-07-17 21:12:47,726 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:47,726 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628367726"}]},"ts":"1689628367726"} 2023-07-17 21:12:47,728 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 21:12:47,730 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:47,731 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 21:12:47,733 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 21:12:47,737 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,737 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,737 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,737 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:47,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:47,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:47,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:47,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:47,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 460 msec 2023-07-17 21:12:47,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:47,897 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 21:12:47,899 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:47,899 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:47,901 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:47,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628367923 (current time:1689628367923). 2023-07-17 21:12:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x049d29ac to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:47,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472a8d38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:47,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:47,940 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:47,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049d29ac to 127.0.0.1:60809 2023-07-17 21:12:47,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:47,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x5e4ce024 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:47,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33716208, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:47,951 DEBUG [hconnection-0x20a16a13-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:47,954 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:47,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e4ce024 to 127.0.0.1:60809 2023-07-17 21:12:47,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:47,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 21:12:47,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:47,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:47,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:47,962 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:47,963 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689628967963 2023-07-17 21:12:47,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:47,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:47,964 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:47,964 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:47,965 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:47,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:47,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-17 21:12:47,967 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:47,967 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689628967967 2023-07-17 21:12:48,064 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:48,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:48,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:48,065 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:48,266 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:48,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:48,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:48,269 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:48,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,415 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 21:12:48,415 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:48,415 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 21:12:48,415 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 21:12:48,415 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,415 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,417 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:48,417 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:48,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:48,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,417 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,417 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:48,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,419 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,419 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 21:12:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 21:12:48,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,420 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,421 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:48,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 21:12:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:48,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,421 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:48,421 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:48,440 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:48,440 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:48,440 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:48,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:48,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:48,446 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:48,446 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:48,446 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:48,450 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,450 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,453 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:48,453 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,453 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,453 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:48,453 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,453 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:48,453 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:48,454 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:48,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:48,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:48,458 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 21:12:48,458 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:48,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,467 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,467 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:48,467 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:48,468 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,468 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:48,467 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:48,469 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:48,472 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:48,472 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:48,478 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:48,479 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:48,479 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:48,479 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:48,479 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. started... 2023-07-17 21:12:48,479 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. started... 2023-07-17 21:12:48,481 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 444116285094382bbceb792594982921: 2023-07-17 21:12:48,481 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,481 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:48,481 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:48,484 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9ddf003cf091d6438d37a1b5d86ff66: 2023-07-17 21:12:48,484 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,484 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:48,484 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:48,527 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. completed. 2023-07-17 21:12:48,528 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. completed. 2023-07-17 21:12:48,528 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:48,528 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:48,528 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:48,531 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:48,533 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:48,533 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:48,533 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,533 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:48,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 21:12:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:12:48,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 21:12:48,543 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 21:12:48,543 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:48,543 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:48,543 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,543 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:48,545 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:48,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:48,546 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:48,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,548 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,548 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,553 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:48,560 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,561 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,569 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:48,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:48,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:48,571 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:48,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:48,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:48,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,572 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,573 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:48,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:12:48,573 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,575 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:48,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:48,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:48,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:48,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:48,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:48,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,576 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 21:12:48,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 21:12:48,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,724 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:48,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689628367963Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689628368612 (+649 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628368612Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628368612Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628368625 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628368663 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689628368724 (+61 ms) 2023-07-17 21:12:48,728 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:48,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 764 msec 2023-07-17 21:12:49,071 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:49,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:49,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:49,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:49,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46043] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:49,087 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,087 DEBUG [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:49,087 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:49,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628369100 (current time:1689628369100). 2023-07-17 21:12:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:49,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x235dd71a to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:49,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@807d090, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:49,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:49,124 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:49,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x235dd71a to 127.0.0.1:60809 2023-07-17 21:12:49,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:49,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(139): Connect 0x15a3a4b7 to 127.0.0.1:60809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:49,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588b541e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:49,147 DEBUG [hconnection-0x6ebe8ccf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:49,148 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15a3a4b7 to 127.0.0.1:60809 2023-07-17 21:12:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 21:12:49,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:49,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:49,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:49,161 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:49,162 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689628969162 2023-07-17 21:12:49,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:49,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:49,165 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:49,165 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:49,166 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:49,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-17 21:12:49,168 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:49,169 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689628969169 2023-07-17 21:12:49,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,219 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 21:12:49,219 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:49,221 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 21:12:49,221 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 21:12:49,221 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,221 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,224 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:49,224 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:49,224 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:49,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:49,224 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:49,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:49,224 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,224 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,225 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,225 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,226 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:49,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:49,244 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:49,244 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:49,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,244 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:49,244 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:49,244 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:49,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,245 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:49,245 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39595,1689628244095' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:49,250 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:49,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:49,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,253 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,254 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,254 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,254 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,254 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,254 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:49,254 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,254 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,255 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,255 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:49,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1689628244150' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:49,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2176756e[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:49,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46043,1689628244012' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:49,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2176756e[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:49,259 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 21:12:49,259 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,266 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:49,267 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,267 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:49,267 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:49,267 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39595,1689628244095' in zk 2023-07-17 21:12:49,267 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,268 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:49,268 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:49,269 DEBUG [member: 'jenkins-hbase4.apache.org,39595,1689628244095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:49,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,270 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:49,271 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:49,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:49,271 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,271 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:49,272 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:49,275 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:49,275 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. started... 2023-07-17 21:12:49,275 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b9ddf003cf091d6438d37a1b5d86ff66 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 21:12:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:49,283 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:49,283 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. started... 2023-07-17 21:12:49,283 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 444116285094382bbceb792594982921 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 21:12:49,411 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230717c20a1487efd6453881700843dac5e0f2 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230717c20a1487efd6453881700843dac5e0f2 2023-07-17 21:12:49,466 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/.tmp/cf/c66548a7ccba480c823f37074485b6b5 2023-07-17 21:12:49,472 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:49,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:49,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:49,473 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:49,475 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/.tmp/cf/c66548a7ccba480c823f37074485b6b5 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf/c66548a7ccba480c823f37074485b6b5 2023-07-17 21:12:49,480 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf/c66548a7ccba480c823f37074485b6b5, entries=46, sequenceid=6, filesize=13.2 K 2023-07-17 21:12:49,481 INFO [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 444116285094382bbceb792594982921 in 198ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:49,481 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 21:12:49,481 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 444116285094382bbceb792594982921: 2023-07-17 21:12:49,482 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,482 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:49,482 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf/c66548a7ccba480c823f37074485b6b5] hfiles 2023-07-17 21:12:49,482 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf/c66548a7ccba480c823f37074485b6b5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,497 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. completed. 2023-07-17 21:12:49,497 DEBUG [rs(jenkins-hbase4.apache.org,44933,1689628244150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44933,1689628244150' in zk 2023-07-17 21:12:49,499 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:49,500 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,500 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:49,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:49,500 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1689628244150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:49,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:49,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:49,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:49,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44933,1689628244150': 2023-07-17 21:12:49,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1689628244150' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 21:12:49,762 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307175719016ddcb64352a89e765797b0de12 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307175719016ddcb64352a89e765797b0de12 2023-07-17 21:12:49,773 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:49,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:49,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:49,774 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 21:12:49,788 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/.tmp/cf/56d0da0e98e54216b99bb333d46649bd 2023-07-17 21:12:49,793 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/.tmp/cf/56d0da0e98e54216b99bb333d46649bd as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf/56d0da0e98e54216b99bb333d46649bd 2023-07-17 21:12:49,802 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf/56d0da0e98e54216b99bb333d46649bd, entries=4, sequenceid=6, filesize=5.6 K 2023-07-17 21:12:49,803 INFO [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b9ddf003cf091d6438d37a1b5d86ff66 in 528ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:49,806 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9ddf003cf091d6438d37a1b5d86ff66: 2023-07-17 21:12:49,807 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,807 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:49,807 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf/56d0da0e98e54216b99bb333d46649bd] hfiles 2023-07-17 21:12:49,807 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf/56d0da0e98e54216b99bb333d46649bd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,866 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. completed. 2023-07-17 21:12:49,866 DEBUG [rs(jenkins-hbase4.apache.org,46043,1689628244012)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:12:49,866 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:49,867 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:49,867 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,867 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:49,867 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46043,1689628244012' in zk 2023-07-17 21:12:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:49,869 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,46043,1689628244012' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46043,1689628244012': 2023-07-17 21:12:49,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46043,1689628244012' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 21:12:49,882 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 21:12:49,882 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:49,883 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:49,883 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,883 INFO [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:49,886 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,886 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:49,887 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,887 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:49,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:49,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:49,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,888 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,888 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:49,889 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:49,892 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,893 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,893 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:49,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,898 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:12:49,898 DEBUG [(jenkins-hbase4.apache.org,33275,1689628242520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:49,897 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:49,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:49,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:49,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,898 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:49,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 21:12:49,898 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:12:49,898 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,898 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:49,901 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:49,901 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:49,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:49,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:49,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230717c20a1487efd6453881700843dac5e0f2, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307175719016ddcb64352a89e765797b0de12] mob files 2023-07-17 21:12:49,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230717c20a1487efd6453881700843dac5e0f2 2023-07-17 21:12:49,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307175719016ddcb64352a89e765797b0de12 2023-07-17 21:12:49,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:49,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:49,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:50,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 21:12:50,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:50,037 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:50,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689628369162Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689628369952 (+790 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689628369952Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689628369953 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689628369960 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689628369980 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689628370036 (+56 ms) 2023-07-17 21:12:50,041 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:50,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 878 msec 2023-07-17 21:12:50,275 DEBUG [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:50,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:50,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:50,276 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276 2023-07-17 21:12:50,277 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34459, tgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276, rawTgtDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276, srcFsUri=hdfs://localhost:34459, srcDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:12:50,316 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99 2023-07-17 21:12:50,316 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-367070371_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:50,317 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34459, inputRoot=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99, snapshotDir=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 21:12:50,368 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:50,537 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:50,538 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:50,538 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:50,539 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:50,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0006_000001 (auth:SIMPLE) 2023-07-17 21:12:51,800 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-8746776108305149359.jar 2023-07-17 21:12:51,800 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,801 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,897 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/hadoop-3679777497566697015.jar 2023-07-17 21:12:51,898 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,899 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,899 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,900 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,901 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,901 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:51,902 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:12:51,902 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:12:51,903 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:12:51,903 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:12:51,904 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:12:51,905 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:12:51,905 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:12:51,906 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:12:51,906 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:12:51,907 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:12:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:51,909 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:51,910 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:51,910 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:51,911 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:51,912 DEBUG [Listener at jenkins-hbase4.apache.org/43825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:52,744 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:53,119 WARN [Listener at jenkins-hbase4.apache.org/43825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:12:53,121 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 21:12:53,124 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-17 21:12:53,251 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:53,251 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:54,070 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0007_000001 (auth:SIMPLE) 2023-07-17 21:13:00,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0007_000001 (auth:SIMPLE) 2023-07-17 21:13:02,349 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0007_000001 (auth:SIMPLE) 2023-07-17 21:13:05,825 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253218_0007_000001 (auth:SIMPLE) 2023-07-17 21:13:07,591 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:13:07,591 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:13:07,605 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,605 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:13:07,606 INFO [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:13:07,606 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,607 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 21:13:07,607 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 21:13:07,607 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_555129325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,608 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 21:13:07,608 DEBUG [Listener at jenkins-hbase4.apache.org/43825] snapshot.TestExportSnapshot(367): hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/export-test/export-1689628370276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 21:13:07,614 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 21:13:07,617 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628387617"}]},"ts":"1689628387617"} 2023-07-17 21:13:07,619 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 21:13:07,620 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 21:13:07,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, UNASSIGN}] 2023-07-17 21:13:07,622 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, UNASSIGN 2023-07-17 21:13:07,622 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, UNASSIGN 2023-07-17 21:13:07,623 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b9ddf003cf091d6438d37a1b5d86ff66, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:13:07,623 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=444116285094382bbceb792594982921, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:13:07,623 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628387623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628387623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628387623"}]},"ts":"1689628387623"} 2023-07-17 21:13:07,623 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628387623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628387623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628387623"}]},"ts":"1689628387623"} 2023-07-17 21:13:07,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure b9ddf003cf091d6438d37a1b5d86ff66, server=jenkins-hbase4.apache.org,46043,1689628244012}] 2023-07-17 21:13:07,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 444116285094382bbceb792594982921, server=jenkins-hbase4.apache.org,44933,1689628244150}] 2023-07-17 21:13:07,661 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,46043,1689628244012, timeout=1689628387775, delay=114, operations=[pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure b9ddf003cf091d6438d37a1b5d86ff66, server=jenkins-hbase4.apache.org,46043,1689628244012], containedObject=jenkins-hbase4.apache.org,44933,1689628244150, timeout=1689628387776, delay=115, operations=[pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 444116285094382bbceb792594982921, server=jenkins-hbase4.apache.org,44933,1689628244150]] 2023-07-17 21:13:07,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 21:13:07,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:13:07,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b9ddf003cf091d6438d37a1b5d86ff66, disabling compactions & flushes 2023-07-17 21:13:07,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:13:07,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:13:07,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. after waiting 0 ms 2023-07-17 21:13:07,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:13:07,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 444116285094382bbceb792594982921 2023-07-17 21:13:07,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 444116285094382bbceb792594982921, disabling compactions & flushes 2023-07-17 21:13:07,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:13:07,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:13:07,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. after waiting 0 ms 2023-07-17 21:13:07,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:13:07,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:13:07,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:07,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921. 2023-07-17 21:13:07,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 444116285094382bbceb792594982921: 2023-07-17 21:13:07,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:13:07,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 444116285094382bbceb792594982921 2023-07-17 21:13:07,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:07,803 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=444116285094382bbceb792594982921, regionState=CLOSED 2023-07-17 21:13:07,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66. 2023-07-17 21:13:07,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b9ddf003cf091d6438d37a1b5d86ff66: 2023-07-17 21:13:07,804 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628387803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628387803"}]},"ts":"1689628387803"} 2023-07-17 21:13:07,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=b9ddf003cf091d6438d37a1b5d86ff66, regionState=CLOSED 2023-07-17 21:13:07,806 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628387806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628387806"}]},"ts":"1689628387806"} 2023-07-17 21:13:07,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:13:07,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-17 21:13:07,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 444116285094382bbceb792594982921, server=jenkins-hbase4.apache.org,44933,1689628244150 in 181 msec 2023-07-17 21:13:07,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=444116285094382bbceb792594982921, UNASSIGN in 187 msec 2023-07-17 21:13:07,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-17 21:13:07,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure b9ddf003cf091d6438d37a1b5d86ff66, server=jenkins-hbase4.apache.org,46043,1689628244012 in 187 msec 2023-07-17 21:13:07,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-17 21:13:07,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b9ddf003cf091d6438d37a1b5d86ff66, UNASSIGN in 195 msec 2023-07-17 21:13:07,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628387818"}]},"ts":"1689628387818"} 2023-07-17 21:13:07,819 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 21:13:07,821 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 21:13:07,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 207 msec 2023-07-17 21:13:07,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 21:13:07,919 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 21:13:07,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,923 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,924 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,926 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46043] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,928 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:13:07,928 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 2023-07-17 21:13:07,929 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,929 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,929 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 21:13:07,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 21:13:07,930 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,931 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,931 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:07,931 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:07,931 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:07,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-17 21:13:07,931 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-17 21:13:07,931 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:13:07,931 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:07,931 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:13:07,932 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/recovered.edits] 2023-07-17 21:13:07,932 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf, FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/recovered.edits] 2023-07-17 21:13:07,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 21:13:07,937 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf/c66548a7ccba480c823f37074485b6b5 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/cf/c66548a7ccba480c823f37074485b6b5 2023-07-17 21:13:07,937 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf/56d0da0e98e54216b99bb333d46649bd to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/cf/56d0da0e98e54216b99bb333d46649bd 2023-07-17 21:13:07,940 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921/recovered.edits/9.seqid 2023-07-17 21:13:07,940 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/recovered.edits/9.seqid to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66/recovered.edits/9.seqid 2023-07-17 21:13:07,940 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/444116285094382bbceb792594982921 2023-07-17 21:13:07,940 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b9ddf003cf091d6438d37a1b5d86ff66 2023-07-17 21:13:07,940 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 21:13:07,941 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-17 21:13:07,941 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-17 21:13:07,945 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230717c20a1487efd6453881700843dac5e0f2 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230717c20a1487efd6453881700843dac5e0f2 2023-07-17 21:13:07,946 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307175719016ddcb64352a89e765797b0de12 to hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307175719016ddcb64352a89e765797b0de12 2023-07-17 21:13:07,946 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-17 21:13:07,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,950 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 21:13:07,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 21:13:07,953 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,953 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 21:13:07,953 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628387953"}]},"ts":"9223372036854775807"} 2023-07-17 21:13:07,953 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628387953"}]},"ts":"9223372036854775807"} 2023-07-17 21:13:07,955 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:13:07,955 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b9ddf003cf091d6438d37a1b5d86ff66, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689628367279.b9ddf003cf091d6438d37a1b5d86ff66.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 444116285094382bbceb792594982921, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628367279.444116285094382bbceb792594982921.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:13:07,955 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 21:13:07,955 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628387955"}]},"ts":"9223372036854775807"} 2023-07-17 21:13:07,956 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 21:13:07,958 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:07,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-07-17 21:13:08,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 21:13:08,037 INFO [Listener at jenkins-hbase4.apache.org/43825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 21:13:08,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 21:13:08,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:08,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 21:13:08,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33275] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:08,084 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759 (was 763), OpenFileDescriptor=898 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=716 (was 671) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 183), AvailableMemoryMB=1842 (was 2071) 2023-07-17 21:13:08,084 WARN [Listener at jenkins-hbase4.apache.org/43825] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-17 21:13:08,084 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 21:13:08,098 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:08,222 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689628253218_0007_01_000001 is : 143 2023-07-17 21:13:13,379 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:13:22,237 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:36,356 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 21:13:36,357 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:36,466 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 21:13:36,477 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 21:13:36,478 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 21:13:36,488 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:36,592 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 21:13:36,592 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 21:13:36,593 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 21:13:36,593 INFO [Listener at jenkins-hbase4.apache.org/43825] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 21:13:36,593 DEBUG [Listener at jenkins-hbase4.apache.org/43825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0aad9b51 to 127.0.0.1:60809 2023-07-17 21:13:36,593 DEBUG [Listener at jenkins-hbase4.apache.org/43825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,593 DEBUG [Listener at jenkins-hbase4.apache.org/43825] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 21:13:36,593 DEBUG [Listener at jenkins-hbase4.apache.org/43825] util.JVMClusterUtil(257): Found active master hash=727074255, stopped=false 2023-07-17 21:13:36,594 DEBUG [Listener at jenkins-hbase4.apache.org/43825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,594 DEBUG [Listener at jenkins-hbase4.apache.org/43825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 21:13:36,594 INFO [Listener at jenkins-hbase4.apache.org/43825] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:13:36,597 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:36,597 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:36,597 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:36,597 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:36,597 INFO [Listener at jenkins-hbase4.apache.org/43825] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 21:13:36,597 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:13:36,597 DEBUG [Listener at jenkins-hbase4.apache.org/43825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06e566fa to 127.0.0.1:60809 2023-07-17 21:13:36,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:36,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:36,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:36,597 DEBUG [Listener at jenkins-hbase4.apache.org/43825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:36,598 INFO [Listener at jenkins-hbase4.apache.org/43825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46043,1689628244012' ***** 2023-07-17 21:13:36,598 DEBUG [Listener at jenkins-hbase4.apache.org/43825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,598 INFO [Listener at jenkins-hbase4.apache.org/43825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 21:13:36,598 INFO [Listener at jenkins-hbase4.apache.org/43825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39595,1689628244095' ***** 2023-07-17 21:13:36,598 DEBUG [Listener at jenkins-hbase4.apache.org/43825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,598 INFO [Listener at jenkins-hbase4.apache.org/43825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 21:13:36,599 INFO [RS:0;jenkins-hbase4:46043] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 21:13:36,599 INFO [RS:1;jenkins-hbase4:39595] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 21:13:36,599 INFO [RS:0;jenkins-hbase4:46043] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 21:13:36,599 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 21:13:36,599 INFO [RS:1;jenkins-hbase4:39595] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 21:13:36,599 INFO [RS:1;jenkins-hbase4:39595] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 21:13:36,599 INFO [Listener at jenkins-hbase4.apache.org/43825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44933,1689628244150' ***** 2023-07-17 21:13:36,599 DEBUG [Listener at jenkins-hbase4.apache.org/43825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,599 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 21:13:36,599 INFO [RS:0;jenkins-hbase4:46043] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 21:13:36,599 INFO [Listener at jenkins-hbase4.apache.org/43825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 21:13:36,600 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(3305): Received CLOSE for dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:13:36,599 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(3305): Received CLOSE for e7a9537e59d7789054b7794bee20b772 2023-07-17 21:13:36,600 INFO [RS:2;jenkins-hbase4:44933] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 21:13:36,600 INFO [RS:2;jenkins-hbase4:44933] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 21:13:36,600 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:13:36,600 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 21:13:36,600 DEBUG [RS:1;jenkins-hbase4:39595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d3ccca5 to 127.0.0.1:60809 2023-07-17 21:13:36,600 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:13:36,600 INFO [RS:2;jenkins-hbase4:44933] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 21:13:36,602 DEBUG [RS:0;jenkins-hbase4:46043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ae90ba to 127.0.0.1:60809 2023-07-17 21:13:36,602 DEBUG [RS:1;jenkins-hbase4:39595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7a9537e59d7789054b7794bee20b772, disabling compactions & flushes 2023-07-17 21:13:36,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc48b3885348eb9bc727ef7b11b94a09, disabling compactions & flushes 2023-07-17 21:13:36,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:13:36,604 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 21:13:36,604 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:36,604 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1478): Online Regions={e7a9537e59d7789054b7794bee20b772=hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772.} 2023-07-17 21:13:36,605 DEBUG [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1504): Waiting on e7a9537e59d7789054b7794bee20b772 2023-07-17 21:13:36,602 DEBUG [RS:0;jenkins-hbase4:46043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,602 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:13:36,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:13:36,605 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08a007c6 to 127.0.0.1:60809 2023-07-17 21:13:36,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:13:36,607 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,607 INFO [RS:0;jenkins-hbase4:46043] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 21:13:36,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. after waiting 0 ms 2023-07-17 21:13:36,608 INFO [RS:0;jenkins-hbase4:46043] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 21:13:36,608 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44933,1689628244150; all regions closed. 2023-07-17 21:13:36,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:13:36,608 INFO [RS:0;jenkins-hbase4:46043] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 21:13:36,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:13:36,609 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 21:13:36,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. after waiting 0 ms 2023-07-17 21:13:36,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:13:36,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dc48b3885348eb9bc727ef7b11b94a09 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 21:13:36,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e7a9537e59d7789054b7794bee20b772 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 21:13:36,610 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-17 21:13:36,610 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, dc48b3885348eb9bc727ef7b11b94a09=hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09.} 2023-07-17 21:13:36,610 DEBUG [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1504): Waiting on 1588230740, dc48b3885348eb9bc727ef7b11b94a09 2023-07-17 21:13:36,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 21:13:36,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 21:13:36,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 21:13:36,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 21:13:36,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 21:13:36,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 21:13:36,625 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:36,627 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:36,653 DEBUG [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs 2023-07-17 21:13:36,654 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44933%2C1689628244150:(num 1689628246411) 2023-07-17 21:13:36,654 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,655 INFO [RS:2;jenkins-hbase4:44933] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:36,655 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 21:13:36,656 INFO [RS:2;jenkins-hbase4:44933] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 21:13:36,656 INFO [RS:2;jenkins-hbase4:44933] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 21:13:36,656 INFO [RS:2;jenkins-hbase4:44933] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 21:13:36,656 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:36,657 INFO [RS:2;jenkins-hbase4:44933] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44933 2023-07-17 21:13:36,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/.tmp/l/f71b131ae0234288b0f35ed7b6b3cb40 2023-07-17 21:13:36,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/.tmp/info/26c0ce5e8d5d49e48a2033b692222784 2023-07-17 21:13:36,668 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:13:36,668 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:36,668 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:36,668 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:13:36,668 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44933,1689628244150 2023-07-17 21:13:36,669 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:36,668 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:36,669 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44933,1689628244150] 2023-07-17 21:13:36,670 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44933,1689628244150; numProcessing=1 2023-07-17 21:13:36,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/.tmp/info/7c84a12dc3d04708a9c30aef527450c6 2023-07-17 21:13:36,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f71b131ae0234288b0f35ed7b6b3cb40 2023-07-17 21:13:36,672 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44933,1689628244150 already deleted, retry=false 2023-07-17 21:13:36,672 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44933,1689628244150 expired; onlineServers=2 2023-07-17 21:13:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/.tmp/l/f71b131ae0234288b0f35ed7b6b3cb40 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/l/f71b131ae0234288b0f35ed7b6b3cb40 2023-07-17 21:13:36,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26c0ce5e8d5d49e48a2033b692222784 2023-07-17 21:13:36,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f71b131ae0234288b0f35ed7b6b3cb40 2023-07-17 21:13:36,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/l/f71b131ae0234288b0f35ed7b6b3cb40, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 21:13:36,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/.tmp/info/7c84a12dc3d04708a9c30aef527450c6 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/info/7c84a12dc3d04708a9c30aef527450c6 2023-07-17 21:13:36,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for dc48b3885348eb9bc727ef7b11b94a09 in 70ms, sequenceid=18, compaction requested=false 2023-07-17 21:13:36,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/info/7c84a12dc3d04708a9c30aef527450c6, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 21:13:36,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e7a9537e59d7789054b7794bee20b772 in 79ms, sequenceid=6, compaction requested=false 2023-07-17 21:13:36,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/.tmp/rep_barrier/526538f6471e428aab5d1deab7c5d04f 2023-07-17 21:13:36,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/namespace/e7a9537e59d7789054b7794bee20b772/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:13:36,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:13:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7a9537e59d7789054b7794bee20b772: 2023-07-17 21:13:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689628246939.e7a9537e59d7789054b7794bee20b772. 2023-07-17 21:13:36,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/acl/dc48b3885348eb9bc727ef7b11b94a09/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 21:13:36,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:13:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc48b3885348eb9bc727ef7b11b94a09: 2023-07-17 21:13:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689628247816.dc48b3885348eb9bc727ef7b11b94a09. 2023-07-17 21:13:36,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 526538f6471e428aab5d1deab7c5d04f 2023-07-17 21:13:36,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/.tmp/table/df3a7cd124404e9c8fc2159c8562c45d 2023-07-17 21:13:36,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df3a7cd124404e9c8fc2159c8562c45d 2023-07-17 21:13:36,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/.tmp/info/26c0ce5e8d5d49e48a2033b692222784 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/info/26c0ce5e8d5d49e48a2033b692222784 2023-07-17 21:13:36,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26c0ce5e8d5d49e48a2033b692222784 2023-07-17 21:13:36,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/info/26c0ce5e8d5d49e48a2033b692222784, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 21:13:36,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/.tmp/rep_barrier/526538f6471e428aab5d1deab7c5d04f as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/rep_barrier/526538f6471e428aab5d1deab7c5d04f 2023-07-17 21:13:36,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 526538f6471e428aab5d1deab7c5d04f 2023-07-17 21:13:36,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/rep_barrier/526538f6471e428aab5d1deab7c5d04f, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 21:13:36,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/.tmp/table/df3a7cd124404e9c8fc2159c8562c45d as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/table/df3a7cd124404e9c8fc2159c8562c45d 2023-07-17 21:13:36,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df3a7cd124404e9c8fc2159c8562c45d 2023-07-17 21:13:36,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/table/df3a7cd124404e9c8fc2159c8562c45d, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 21:13:36,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 124ms, sequenceid=131, compaction requested=false 2023-07-17 21:13:36,748 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 21:13:36,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:36,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 21:13:36,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 21:13:36,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 21:13:36,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 21:13:36,772 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:36,772 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44933,1689628244150; zookeeper connection closed. 2023-07-17 21:13:36,772 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101751f716f0003, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:36,773 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@59b453a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@59b453a 2023-07-17 21:13:36,805 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39595,1689628244095; all regions closed. 2023-07-17 21:13:36,810 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46043,1689628244012; all regions closed. 2023-07-17 21:13:36,811 DEBUG [RS:1;jenkins-hbase4:39595] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs 2023-07-17 21:13:36,812 INFO [RS:1;jenkins-hbase4:39595] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39595%2C1689628244095:(num 1689628246411) 2023-07-17 21:13:36,812 DEBUG [RS:1;jenkins-hbase4:39595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,812 INFO [RS:1;jenkins-hbase4:39595] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:36,812 INFO [RS:1;jenkins-hbase4:39595] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 21:13:36,813 INFO [RS:1;jenkins-hbase4:39595] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 21:13:36,813 INFO [RS:1;jenkins-hbase4:39595] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 21:13:36,813 INFO [RS:1;jenkins-hbase4:39595] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 21:13:36,813 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:36,815 INFO [RS:1;jenkins-hbase4:39595] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39595 2023-07-17 21:13:36,816 DEBUG [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs 2023-07-17 21:13:36,817 INFO [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46043%2C1689628244012.meta:.meta(num 1689628246578) 2023-07-17 21:13:36,817 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:13:36,817 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:36,817 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39595,1689628244095 2023-07-17 21:13:36,818 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39595,1689628244095] 2023-07-17 21:13:36,818 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39595,1689628244095; numProcessing=2 2023-07-17 21:13:36,821 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/WALs/jenkins-hbase4.apache.org,46043,1689628244012/jenkins-hbase4.apache.org%2C46043%2C1689628244012.1689628246411 not finished, retry = 0 2023-07-17 21:13:36,822 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39595,1689628244095 already deleted, retry=false 2023-07-17 21:13:36,822 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39595,1689628244095 expired; onlineServers=1 2023-07-17 21:13:36,921 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:36,921 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:39595-0x101751f716f0002, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:36,921 INFO [RS:1;jenkins-hbase4:39595] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39595,1689628244095; zookeeper connection closed. 2023-07-17 21:13:36,921 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56bae447] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56bae447 2023-07-17 21:13:36,923 DEBUG [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/oldWALs 2023-07-17 21:13:36,924 INFO [RS:0;jenkins-hbase4:46043] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46043%2C1689628244012:(num 1689628246411) 2023-07-17 21:13:36,924 DEBUG [RS:0;jenkins-hbase4:46043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,924 INFO [RS:0;jenkins-hbase4:46043] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:36,924 INFO [RS:0;jenkins-hbase4:46043] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 21:13:36,924 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:36,925 INFO [RS:0;jenkins-hbase4:46043] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46043 2023-07-17 21:13:36,926 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:36,926 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46043,1689628244012 2023-07-17 21:13:36,932 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46043,1689628244012] 2023-07-17 21:13:36,933 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46043,1689628244012; numProcessing=3 2023-07-17 21:13:36,934 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46043,1689628244012 already deleted, retry=false 2023-07-17 21:13:36,934 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46043,1689628244012 expired; onlineServers=0 2023-07-17 21:13:36,934 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33275,1689628242520' ***** 2023-07-17 21:13:36,934 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 21:13:36,934 DEBUG [M:0;jenkins-hbase4:33275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6b4ff4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:13:36,934 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33275,1689628242520 2023-07-17 21:13:36,934 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33275,1689628242520; all regions closed. 2023-07-17 21:13:36,934 DEBUG [M:0;jenkins-hbase4:33275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:36,934 DEBUG [M:0;jenkins-hbase4:33275] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 21:13:36,934 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 21:13:36,934 DEBUG [M:0;jenkins-hbase4:33275] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 21:13:36,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689628245914] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689628245914,5,FailOnTimeoutGroup] 2023-07-17 21:13:36,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689628245912] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689628245912,5,FailOnTimeoutGroup] 2023-07-17 21:13:36,934 INFO [M:0;jenkins-hbase4:33275] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 21:13:36,934 INFO [M:0;jenkins-hbase4:33275] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 21:13:36,935 INFO [M:0;jenkins-hbase4:33275] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 21:13:36,935 DEBUG [M:0;jenkins-hbase4:33275] master.HMaster(1512): Stopping service threads 2023-07-17 21:13:36,935 INFO [M:0;jenkins-hbase4:33275] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 21:13:36,935 ERROR [M:0;jenkins-hbase4:33275] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-17 21:13:36,935 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 21:13:36,935 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:13:36,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:13:36,936 INFO [M:0;jenkins-hbase4:33275] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 21:13:36,936 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 21:13:36,936 DEBUG [M:0;jenkins-hbase4:33275] zookeeper.ZKUtil(398): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 21:13:36,936 WARN [M:0;jenkins-hbase4:33275] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 21:13:36,936 INFO [M:0;jenkins-hbase4:33275] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 21:13:36,937 INFO [M:0;jenkins-hbase4:33275] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 21:13:36,937 DEBUG [M:0;jenkins-hbase4:33275] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 21:13:36,937 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:36,937 DEBUG [M:0;jenkins-hbase4:33275] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:36,937 DEBUG [M:0;jenkins-hbase4:33275] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 21:13:36,937 DEBUG [M:0;jenkins-hbase4:33275] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:36,937 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.13 KB 2023-07-17 21:13:36,956 INFO [M:0;jenkins-hbase4:33275] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f5246c6fc407438fb0e38d4aeffae2c4 2023-07-17 21:13:36,960 INFO [M:0;jenkins-hbase4:33275] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5246c6fc407438fb0e38d4aeffae2c4 2023-07-17 21:13:36,961 DEBUG [M:0;jenkins-hbase4:33275] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f5246c6fc407438fb0e38d4aeffae2c4 as hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f5246c6fc407438fb0e38d4aeffae2c4 2023-07-17 21:13:36,965 INFO [M:0;jenkins-hbase4:33275] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5246c6fc407438fb0e38d4aeffae2c4 2023-07-17 21:13:36,965 INFO [M:0;jenkins-hbase4:33275] regionserver.HStore(1080): Added hdfs://localhost:34459/user/jenkins/test-data/3ae40eb6-eda7-8326-e1b7-098491bbfe99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f5246c6fc407438fb0e38d4aeffae2c4, entries=119, sequenceid=899, filesize=28.7 K 2023-07-17 21:13:36,965 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384919, heapSize ~452.11 KB/462960, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-17 21:13:36,967 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:36,967 DEBUG [M:0;jenkins-hbase4:33275] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 21:13:36,970 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:36,970 INFO [M:0;jenkins-hbase4:33275] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 21:13:36,971 INFO [M:0;jenkins-hbase4:33275] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33275 2023-07-17 21:13:36,973 DEBUG [M:0;jenkins-hbase4:33275] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33275,1689628242520 already deleted, retry=false 2023-07-17 21:13:37,033 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:37,033 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): regionserver:46043-0x101751f716f0001, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:37,033 INFO [RS:0;jenkins-hbase4:46043] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46043,1689628244012; zookeeper connection closed. 2023-07-17 21:13:37,033 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@59cd2966] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@59cd2966 2023-07-17 21:13:37,033 INFO [Listener at jenkins-hbase4.apache.org/43825] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 21:13:37,133 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:37,133 DEBUG [Listener at localhost/39161-EventThread] zookeeper.ZKWatcher(600): master:33275-0x101751f716f0000, quorum=127.0.0.1:60809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:37,133 INFO [M:0;jenkins-hbase4:33275] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33275,1689628242520; zookeeper connection closed. 2023-07-17 21:13:37,135 WARN [Listener at jenkins-hbase4.apache.org/43825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 21:13:37,139 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:37,244 WARN [BP-1786879280-172.31.14.131-1689628237940 heartbeating to localhost/127.0.0.1:34459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 21:13:37,244 WARN [BP-1786879280-172.31.14.131-1689628237940 heartbeating to localhost/127.0.0.1:34459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1786879280-172.31.14.131-1689628237940 (Datanode Uuid 37a9f4dd-33b2-4e15-b7cf-47cc1cf4ff2a) service to localhost/127.0.0.1:34459 2023-07-17 21:13:37,246 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data5/current/BP-1786879280-172.31.14.131-1689628237940] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:37,247 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data6/current/BP-1786879280-172.31.14.131-1689628237940] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:37,250 WARN [Listener at jenkins-hbase4.apache.org/43825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 21:13:37,254 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:37,357 WARN [BP-1786879280-172.31.14.131-1689628237940 heartbeating to localhost/127.0.0.1:34459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 21:13:37,357 WARN [BP-1786879280-172.31.14.131-1689628237940 heartbeating to localhost/127.0.0.1:34459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1786879280-172.31.14.131-1689628237940 (Datanode Uuid 8cf3b4fe-fb08-4fc0-8217-c60dc0fab90b) service to localhost/127.0.0.1:34459 2023-07-17 21:13:37,357 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data3/current/BP-1786879280-172.31.14.131-1689628237940] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:37,358 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data4/current/BP-1786879280-172.31.14.131-1689628237940] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:37,359 WARN [Listener at jenkins-hbase4.apache.org/43825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 21:13:37,368 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:37,473 WARN [BP-1786879280-172.31.14.131-1689628237940 heartbeating to localhost/127.0.0.1:34459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 21:13:37,473 WARN [BP-1786879280-172.31.14.131-1689628237940 heartbeating to localhost/127.0.0.1:34459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1786879280-172.31.14.131-1689628237940 (Datanode Uuid 0b08c494-e18e-472b-bb5c-9e6c6968456d) service to localhost/127.0.0.1:34459 2023-07-17 21:13:37,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data1/current/BP-1786879280-172.31.14.131-1689628237940] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:37,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce7b9d96-c429-4162-319f-c6f0a9f22094/cluster_07b32839-6bfd-00af-5fa7-bbecfbfb3cb2/dfs/data/data2/current/BP-1786879280-172.31.14.131-1689628237940] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:37,504 INFO [Listener at jenkins-hbase4.apache.org/43825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:37,543 INFO [Listener at jenkins-hbase4.apache.org/43825] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 21:13:37,655 INFO [Listener at jenkins-hbase4.apache.org/43825] hbase.HBaseTestingUtility(1293): Minicluster is down