2023-07-16 09:10:31,958 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 09:10:32,234 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb 2023-07-16 09:10:32,234 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-16 09:10:32,283 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 09:10:32,527 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 09:10:32,528 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15, deleteOnExit=true 2023-07-16 09:10:32,528 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 09:10:32,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/test.cache.data in system properties and HBase conf 2023-07-16 09:10:32,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 09:10:32,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop.log.dir in system properties and HBase conf 2023-07-16 09:10:32,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 09:10:32,530 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 09:10:32,530 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 09:10:32,854 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 09:10:32,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:32,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:32,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 09:10:32,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:32,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 09:10:32,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 09:10:32,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:32,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:32,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 09:10:32,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/nfs.dump.dir in system properties and HBase conf 2023-07-16 09:10:32,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir in system properties and HBase conf 2023-07-16 09:10:32,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:32,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 09:10:32,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 09:10:33,525 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 09:10:33,529 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 09:10:33,804 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 09:10:33,987 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 09:10:34,003 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:34,040 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:34,074 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_localhost_36457_hdfs____1yzuil/webapp 2023-07-16 09:10:34,219 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36457 2023-07-16 09:10:34,247 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 09:10:34,248 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 09:10:34,796 WARN [Listener at localhost/33301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:34,894 WARN [Listener at localhost/33301] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 09:10:34,920 WARN [Listener at localhost/33301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:34,929 INFO [Listener at localhost/33301] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:34,937 INFO [Listener at localhost/33301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_localhost_39961_datanode____d3wt4l/webapp 2023-07-16 09:10:35,075 INFO [Listener at localhost/33301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39961 2023-07-16 09:10:35,544 WARN [Listener at localhost/39169] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:35,570 WARN [Listener at localhost/39169] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 09:10:35,574 WARN [Listener at localhost/39169] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:35,576 INFO [Listener at localhost/39169] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:35,583 INFO [Listener at localhost/39169] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_localhost_45589_datanode____.ez443o/webapp 2023-07-16 09:10:35,703 INFO [Listener at localhost/39169] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45589 2023-07-16 09:10:35,721 WARN [Listener at localhost/33273] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:35,773 WARN [Listener at localhost/33273] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 09:10:35,778 WARN [Listener at localhost/33273] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:35,780 INFO [Listener at localhost/33273] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:35,787 INFO [Listener at localhost/33273] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_localhost_40545_datanode____92aich/webapp 2023-07-16 09:10:35,942 INFO [Listener at localhost/33273] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40545 2023-07-16 09:10:35,959 WARN [Listener at localhost/43761] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:36,290 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x514ad9e8219c4851: Processing first storage report for DS-13dc0342-8b24-4c56-b741-6615f631533a from datanode eac4b949-0890-47eb-b5fe-33528ae8c9b5 2023-07-16 09:10:36,291 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x514ad9e8219c4851: from storage DS-13dc0342-8b24-4c56-b741-6615f631533a node DatanodeRegistration(127.0.0.1:35841, datanodeUuid=eac4b949-0890-47eb-b5fe-33528ae8c9b5, infoPort=42451, infoSecurePort=0, ipcPort=43761, storageInfo=lv=-57;cid=testClusterID;nsid=1356390757;c=1689498633600), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,292 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88a800e6fec4f341: Processing first storage report for DS-f6dbb693-020d-4736-a639-6d6751a2e066 from datanode bd559ca0-edb1-45e5-9b3c-89cadbc002c7 2023-07-16 09:10:36,292 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88a800e6fec4f341: from storage DS-f6dbb693-020d-4736-a639-6d6751a2e066 node DatanodeRegistration(127.0.0.1:39341, datanodeUuid=bd559ca0-edb1-45e5-9b3c-89cadbc002c7, infoPort=35279, infoSecurePort=0, ipcPort=39169, storageInfo=lv=-57;cid=testClusterID;nsid=1356390757;c=1689498633600), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88a800e6fec4f341: Processing first storage report for DS-5a142153-e2b3-4a9e-9076-212f4197ea15 from datanode bd559ca0-edb1-45e5-9b3c-89cadbc002c7 2023-07-16 09:10:36,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88a800e6fec4f341: from storage DS-5a142153-e2b3-4a9e-9076-212f4197ea15 node DatanodeRegistration(127.0.0.1:39341, datanodeUuid=bd559ca0-edb1-45e5-9b3c-89cadbc002c7, infoPort=35279, infoSecurePort=0, ipcPort=39169, storageInfo=lv=-57;cid=testClusterID;nsid=1356390757;c=1689498633600), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x514ad9e8219c4851: Processing first storage report for DS-889a3d4f-f6b4-483f-a9e5-896febebd8c6 from datanode eac4b949-0890-47eb-b5fe-33528ae8c9b5 2023-07-16 09:10:36,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x514ad9e8219c4851: from storage DS-889a3d4f-f6b4-483f-a9e5-896febebd8c6 node DatanodeRegistration(127.0.0.1:35841, datanodeUuid=eac4b949-0890-47eb-b5fe-33528ae8c9b5, infoPort=42451, infoSecurePort=0, ipcPort=43761, storageInfo=lv=-57;cid=testClusterID;nsid=1356390757;c=1689498633600), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x630f14fd4226c2e7: Processing first storage report for DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09 from datanode 215dacd7-4f69-481c-b7e0-cc9a9db81a1c 2023-07-16 09:10:36,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x630f14fd4226c2e7: from storage DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09 node DatanodeRegistration(127.0.0.1:42229, datanodeUuid=215dacd7-4f69-481c-b7e0-cc9a9db81a1c, infoPort=39909, infoSecurePort=0, ipcPort=33273, storageInfo=lv=-57;cid=testClusterID;nsid=1356390757;c=1689498633600), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x630f14fd4226c2e7: Processing first storage report for DS-e284ab11-8407-468f-9dc3-fd1c47cb50ca from datanode 215dacd7-4f69-481c-b7e0-cc9a9db81a1c 2023-07-16 09:10:36,299 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x630f14fd4226c2e7: from storage DS-e284ab11-8407-468f-9dc3-fd1c47cb50ca node DatanodeRegistration(127.0.0.1:42229, datanodeUuid=215dacd7-4f69-481c-b7e0-cc9a9db81a1c, infoPort=39909, infoSecurePort=0, ipcPort=33273, storageInfo=lv=-57;cid=testClusterID;nsid=1356390757;c=1689498633600), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,492 DEBUG [Listener at localhost/43761] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb 2023-07-16 09:10:36,591 INFO [Listener at localhost/43761] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/zookeeper_0, clientPort=59352, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 09:10:36,615 INFO [Listener at localhost/43761] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59352 2023-07-16 09:10:36,626 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:36,629 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:37,353 INFO [Listener at localhost/43761] util.FSUtils(471): Created version file at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb with version=8 2023-07-16 09:10:37,354 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/hbase-staging 2023-07-16 09:10:37,772 INFO [Listener at localhost/43761] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 09:10:38,387 INFO [Listener at localhost/43761] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:38,426 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:38,427 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:38,428 INFO [Listener at localhost/43761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:38,428 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:38,428 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:38,609 INFO [Listener at localhost/43761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:38,691 DEBUG [Listener at localhost/43761] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 09:10:38,794 INFO [Listener at localhost/43761] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39521 2023-07-16 09:10:38,807 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:38,809 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:38,832 INFO [Listener at localhost/43761] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39521 connecting to ZooKeeper ensemble=127.0.0.1:59352 2023-07-16 09:10:38,882 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:395210x0, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:38,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39521-0x1016d65d4180000 connected 2023-07-16 09:10:38,937 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:38,938 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:38,957 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:38,970 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39521 2023-07-16 09:10:38,972 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39521 2023-07-16 09:10:38,976 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39521 2023-07-16 09:10:38,978 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39521 2023-07-16 09:10:38,982 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39521 2023-07-16 09:10:38,990 INFO [Listener at localhost/43761] master.HMaster(444): hbase.rootdir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, hbase.cluster.distributed=false 2023-07-16 09:10:39,061 INFO [Listener at localhost/43761] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:39,061 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,062 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,062 INFO [Listener at localhost/43761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:39,062 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,062 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:39,067 INFO [Listener at localhost/43761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:39,071 INFO [Listener at localhost/43761] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46593 2023-07-16 09:10:39,073 INFO [Listener at localhost/43761] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 09:10:39,085 DEBUG [Listener at localhost/43761] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 09:10:39,086 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,088 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,090 INFO [Listener at localhost/43761] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46593 connecting to ZooKeeper ensemble=127.0.0.1:59352 2023-07-16 09:10:39,095 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:465930x0, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:39,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46593-0x1016d65d4180001 connected 2023-07-16 09:10:39,096 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,097 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,098 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,103 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46593 2023-07-16 09:10:39,103 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46593 2023-07-16 09:10:39,103 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46593 2023-07-16 09:10:39,105 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46593 2023-07-16 09:10:39,106 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46593 2023-07-16 09:10:39,119 INFO [Listener at localhost/43761] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:39,119 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,119 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,120 INFO [Listener at localhost/43761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:39,120 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,120 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:39,120 INFO [Listener at localhost/43761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:39,122 INFO [Listener at localhost/43761] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34051 2023-07-16 09:10:39,122 INFO [Listener at localhost/43761] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 09:10:39,126 DEBUG [Listener at localhost/43761] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 09:10:39,127 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,130 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,133 INFO [Listener at localhost/43761] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34051 connecting to ZooKeeper ensemble=127.0.0.1:59352 2023-07-16 09:10:39,137 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:340510x0, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:39,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34051-0x1016d65d4180002 connected 2023-07-16 09:10:39,139 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,140 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,141 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,143 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34051 2023-07-16 09:10:39,143 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34051 2023-07-16 09:10:39,150 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34051 2023-07-16 09:10:39,154 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34051 2023-07-16 09:10:39,155 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34051 2023-07-16 09:10:39,173 INFO [Listener at localhost/43761] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:39,174 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,174 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,174 INFO [Listener at localhost/43761] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:39,174 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,175 INFO [Listener at localhost/43761] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:39,175 INFO [Listener at localhost/43761] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:39,178 INFO [Listener at localhost/43761] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36871 2023-07-16 09:10:39,179 INFO [Listener at localhost/43761] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 09:10:39,183 DEBUG [Listener at localhost/43761] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 09:10:39,184 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,186 INFO [Listener at localhost/43761] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,187 INFO [Listener at localhost/43761] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36871 connecting to ZooKeeper ensemble=127.0.0.1:59352 2023-07-16 09:10:39,192 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:368710x0, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,193 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:368710x0, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,194 DEBUG [Listener at localhost/43761] zookeeper.ZKUtil(164): regionserver:368710x0, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,198 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:368710x0, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:39,207 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36871 2023-07-16 09:10:39,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36871-0x1016d65d4180003 connected 2023-07-16 09:10:39,210 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36871 2023-07-16 09:10:39,222 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36871 2023-07-16 09:10:39,247 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36871 2023-07-16 09:10:39,249 DEBUG [Listener at localhost/43761] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36871 2023-07-16 09:10:39,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:39,271 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 09:10:39,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:39,296 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,296 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,297 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:39,297 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,297 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 09:10:39,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 09:10:39,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39521,1689498637562 from backup master directory 2023-07-16 09:10:39,306 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:39,306 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 09:10:39,307 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:39,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:39,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 09:10:39,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 09:10:39,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/hbase.id with ID: ad465040-3b1c-4c23-9bc2-4d1ca7fda1de 2023-07-16 09:10:39,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,503 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:39,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5037eedb to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:39,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11c34b16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:39,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:39,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 09:10:39,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 09:10:39,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 09:10:39,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 09:10:39,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 09:10:39,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:39,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store-tmp 2023-07-16 09:10:39,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:39,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 09:10:39,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 09:10:39,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 09:10:39,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/WALs/jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:39,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39521%2C1689498637562, suffix=, logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/WALs/jenkins-hbase4.apache.org,39521,1689498637562, archiveDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/oldWALs, maxLogs=10 2023-07-16 09:10:39,934 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK] 2023-07-16 09:10:39,934 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK] 2023-07-16 09:10:39,934 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK] 2023-07-16 09:10:39,945 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 09:10:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/WALs/jenkins-hbase4.apache.org,39521,1689498637562/jenkins-hbase4.apache.org%2C39521%2C1689498637562.1689498639884 2023-07-16 09:10:40,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK], DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK], DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK]] 2023-07-16 09:10:40,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:40,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:40,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,137 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,160 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 09:10:40,212 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 09:10:40,229 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:40,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:40,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67743270, jitterRate=0.009453386068344116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:40,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 09:10:40,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 09:10:40,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 09:10:40,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 09:10:40,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 09:10:40,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 09:10:40,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-16 09:10:40,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 09:10:40,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 09:10:40,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 09:10:40,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 09:10:40,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 09:10:40,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 09:10:40,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 09:10:40,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 09:10:40,434 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 09:10:40,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 09:10:40,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 09:10:40,460 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,460 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,460 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,461 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,461 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39521,1689498637562, sessionid=0x1016d65d4180000, setting cluster-up flag (Was=false) 2023-07-16 09:10:40,487 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 09:10:40,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:40,513 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 09:10:40,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:40,531 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp 2023-07-16 09:10:40,573 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(951): ClusterId : ad465040-3b1c-4c23-9bc2-4d1ca7fda1de 2023-07-16 09:10:40,576 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(951): ClusterId : ad465040-3b1c-4c23-9bc2-4d1ca7fda1de 2023-07-16 09:10:40,578 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(951): ClusterId : ad465040-3b1c-4c23-9bc2-4d1ca7fda1de 2023-07-16 09:10:40,582 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 09:10:40,582 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 09:10:40,582 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 09:10:40,593 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 09:10:40,593 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 09:10:40,593 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 09:10:40,593 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 09:10:40,593 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 09:10:40,593 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 09:10:40,598 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 09:10:40,598 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 09:10:40,598 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 09:10:40,603 DEBUG [RS:0;jenkins-hbase4:46593] zookeeper.ReadOnlyZKClient(139): Connect 0x475c5908 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:40,604 DEBUG [RS:2;jenkins-hbase4:36871] zookeeper.ReadOnlyZKClient(139): Connect 0x44a72ef5 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:40,604 DEBUG [RS:1;jenkins-hbase4:34051] zookeeper.ReadOnlyZKClient(139): Connect 0x3569ee52 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:40,619 DEBUG [RS:0;jenkins-hbase4:46593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18acc4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:40,620 DEBUG [RS:0;jenkins-hbase4:46593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b5693ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:10:40,656 DEBUG [RS:1;jenkins-hbase4:34051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36e547ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:40,656 DEBUG [RS:1;jenkins-hbase4:34051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55559b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:10:40,667 DEBUG [RS:2;jenkins-hbase4:36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a5b805, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:40,667 DEBUG [RS:2;jenkins-hbase4:36871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3562b6d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:10:40,678 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34051 2023-07-16 09:10:40,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 09:10:40,694 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46593 2023-07-16 09:10:40,695 INFO [RS:0;jenkins-hbase4:46593] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 09:10:40,695 INFO [RS:0;jenkins-hbase4:46593] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 09:10:40,695 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 09:10:40,696 INFO [RS:0;jenkins-hbase4:46593] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,696 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 09:10:40,682 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36871 2023-07-16 09:10:40,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,696 INFO [RS:1;jenkins-hbase4:34051] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 09:10:40,703 INFO [RS:1;jenkins-hbase4:34051] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 09:10:40,703 INFO [RS:2;jenkins-hbase4:36871] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 09:10:40,703 INFO [RS:2;jenkins-hbase4:36871] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 09:10:40,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 09:10:40,703 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 09:10:40,703 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 09:10:40,704 INFO [RS:1;jenkins-hbase4:34051] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,704 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 09:10:40,705 INFO [RS:2;jenkins-hbase4:36871] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,705 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 09:10:40,711 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39521,1689498637562 with isa=jenkins-hbase4.apache.org/172.31.14.131:36871, startcode=1689498639173 2023-07-16 09:10:40,712 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39521,1689498637562 with isa=jenkins-hbase4.apache.org/172.31.14.131:46593, startcode=1689498639060 2023-07-16 09:10:40,712 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39521,1689498637562 with isa=jenkins-hbase4.apache.org/172.31.14.131:34051, startcode=1689498639118 2023-07-16 09:10:40,744 DEBUG [RS:2;jenkins-hbase4:36871] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 09:10:40,745 DEBUG [RS:1;jenkins-hbase4:34051] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 09:10:40,744 DEBUG [RS:0;jenkins-hbase4:46593] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 09:10:40,837 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57643, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 09:10:40,837 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41867, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 09:10:40,841 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41513, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 09:10:40,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 09:10:40,850 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39521] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 09:10:40,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:40,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:40,864 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39521] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 09:10:40,865 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39521] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 09:10:40,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689498670875 2023-07-16 09:10:40,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 09:10:40,878 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 09:10:40,879 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 09:10:40,888 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:40,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 09:10:40,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 09:10:40,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 09:10:40,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 09:10:40,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 09:10:40,921 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 09:10:40,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,922 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 09:10:40,921 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 09:10:40,922 WARN [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 09:10:40,922 WARN [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 09:10:40,922 WARN [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 09:10:40,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 09:10:40,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 09:10:40,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 09:10:40,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 09:10:40,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 09:10:40,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689498640931,5,FailOnTimeoutGroup] 2023-07-16 09:10:40,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689498640940,5,FailOnTimeoutGroup] 2023-07-16 09:10:40,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 09:10:40,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,969 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:40,970 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:40,970 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:10:41,003 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:41,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 09:10:41,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/info 2023-07-16 09:10:41,012 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 09:10:41,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 09:10:41,017 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/rep_barrier 2023-07-16 09:10:41,017 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 09:10:41,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 09:10:41,021 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/table 2023-07-16 09:10:41,022 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 09:10:41,023 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,024 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740 2023-07-16 09:10:41,025 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740 2023-07-16 09:10:41,028 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39521,1689498637562 with isa=jenkins-hbase4.apache.org/172.31.14.131:36871, startcode=1689498639173 2023-07-16 09:10:41,028 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39521,1689498637562 with isa=jenkins-hbase4.apache.org/172.31.14.131:46593, startcode=1689498639060 2023-07-16 09:10:41,029 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39521,1689498637562 with isa=jenkins-hbase4.apache.org/172.31.14.131:34051, startcode=1689498639118 2023-07-16 09:10:41,031 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 09:10:41,034 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 09:10:41,035 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,040 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,042 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:10:41,042 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33301 2023-07-16 09:10:41,042 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,042 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 09:10:41,043 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:10:41,043 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33301 2023-07-16 09:10:41,043 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 09:10:41,044 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:10:41,044 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33301 2023-07-16 09:10:41,044 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 09:10:41,044 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:41,045 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71292101, jitterRate=0.06233508884906769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 09:10:41,045 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 09:10:41,046 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 09:10:41,046 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 09:10:41,046 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 09:10:41,046 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 09:10:41,046 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 09:10:41,047 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 09:10:41,048 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 09:10:41,053 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:10:41,054 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 09:10:41,054 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 09:10:41,055 DEBUG [RS:0;jenkins-hbase4:46593] zookeeper.ZKUtil(162): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,055 WARN [RS:0;jenkins-hbase4:46593] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:41,055 INFO [RS:0;jenkins-hbase4:46593] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,056 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,056 DEBUG [RS:1;jenkins-hbase4:34051] zookeeper.ZKUtil(162): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,057 WARN [RS:1;jenkins-hbase4:34051] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:41,063 INFO [RS:1;jenkins-hbase4:34051] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,064 DEBUG [RS:2;jenkins-hbase4:36871] zookeeper.ZKUtil(162): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,064 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,064 WARN [RS:2;jenkins-hbase4:36871] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:41,065 INFO [RS:2;jenkins-hbase4:36871] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,065 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 09:10:41,081 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46593,1689498639060] 2023-07-16 09:10:41,082 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34051,1689498639118] 2023-07-16 09:10:41,082 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36871,1689498639173] 2023-07-16 09:10:41,093 DEBUG [RS:2;jenkins-hbase4:36871] zookeeper.ZKUtil(162): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,093 DEBUG [RS:0;jenkins-hbase4:46593] zookeeper.ZKUtil(162): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,093 DEBUG [RS:1;jenkins-hbase4:34051] zookeeper.ZKUtil(162): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,094 DEBUG [RS:2;jenkins-hbase4:36871] zookeeper.ZKUtil(162): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,094 DEBUG [RS:0;jenkins-hbase4:46593] zookeeper.ZKUtil(162): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,094 DEBUG [RS:2;jenkins-hbase4:36871] zookeeper.ZKUtil(162): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,095 DEBUG [RS:0;jenkins-hbase4:46593] zookeeper.ZKUtil(162): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,096 DEBUG [RS:1;jenkins-hbase4:34051] zookeeper.ZKUtil(162): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,099 DEBUG [RS:1;jenkins-hbase4:34051] zookeeper.ZKUtil(162): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,102 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 09:10:41,109 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 09:10:41,116 DEBUG [RS:0;jenkins-hbase4:46593] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 09:10:41,116 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 09:10:41,116 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 09:10:41,131 INFO [RS:0;jenkins-hbase4:46593] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 09:10:41,135 INFO [RS:2;jenkins-hbase4:36871] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 09:10:41,131 INFO [RS:1;jenkins-hbase4:34051] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 09:10:41,169 INFO [RS:1;jenkins-hbase4:34051] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 09:10:41,169 INFO [RS:2;jenkins-hbase4:36871] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 09:10:41,169 INFO [RS:0;jenkins-hbase4:46593] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 09:10:41,178 INFO [RS:1;jenkins-hbase4:34051] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 09:10:41,178 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,179 INFO [RS:2;jenkins-hbase4:36871] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 09:10:41,179 INFO [RS:0;jenkins-hbase4:46593] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 09:10:41,184 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 09:10:41,184 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,184 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,185 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 09:10:41,186 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 09:10:41,196 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,196 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,196 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,197 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,197 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,197 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,197 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,197 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:41,198 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:41,198 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,199 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,199 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,199 DEBUG [RS:2;jenkins-hbase4:36871] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,199 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,199 DEBUG [RS:1;jenkins-hbase4:34051] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,198 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,201 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,201 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,201 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:41,201 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,202 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,202 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,202 DEBUG [RS:0;jenkins-hbase4:46593] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,219 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,219 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,219 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,219 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,219 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,219 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,222 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,223 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,223 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,246 INFO [RS:1;jenkins-hbase4:34051] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 09:10:41,246 INFO [RS:0;jenkins-hbase4:46593] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 09:10:41,250 INFO [RS:2;jenkins-hbase4:36871] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 09:10:41,251 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36871,1689498639173-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,251 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46593,1689498639060-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,251 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34051,1689498639118-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,265 DEBUG [jenkins-hbase4:39521] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 09:10:41,270 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:41,277 INFO [RS:0;jenkins-hbase4:46593] regionserver.Replication(203): jenkins-hbase4.apache.org,46593,1689498639060 started 2023-07-16 09:10:41,278 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46593,1689498639060, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46593, sessionid=0x1016d65d4180001 2023-07-16 09:10:41,280 INFO [RS:1;jenkins-hbase4:34051] regionserver.Replication(203): jenkins-hbase4.apache.org,34051,1689498639118 started 2023-07-16 09:10:41,280 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34051,1689498639118, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34051, sessionid=0x1016d65d4180002 2023-07-16 09:10:41,280 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 09:10:41,280 DEBUG [RS:1;jenkins-hbase4:34051] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,280 DEBUG [RS:1;jenkins-hbase4:34051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34051,1689498639118' 2023-07-16 09:10:41,280 DEBUG [RS:1;jenkins-hbase4:34051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 09:10:41,281 DEBUG [RS:1;jenkins-hbase4:34051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 09:10:41,282 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 09:10:41,282 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 09:10:41,282 DEBUG [RS:1;jenkins-hbase4:34051] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:41,282 DEBUG [RS:1;jenkins-hbase4:34051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34051,1689498639118' 2023-07-16 09:10:41,282 DEBUG [RS:1;jenkins-hbase4:34051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:41,283 DEBUG [RS:1;jenkins-hbase4:34051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:41,284 DEBUG [RS:1;jenkins-hbase4:34051] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 09:10:41,284 INFO [RS:1;jenkins-hbase4:34051] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 09:10:41,284 INFO [RS:1;jenkins-hbase4:34051] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 09:10:41,294 INFO [RS:2;jenkins-hbase4:36871] regionserver.Replication(203): jenkins-hbase4.apache.org,36871,1689498639173 started 2023-07-16 09:10:41,295 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36871,1689498639173, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36871, sessionid=0x1016d65d4180003 2023-07-16 09:10:41,295 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 09:10:41,295 DEBUG [RS:2;jenkins-hbase4:36871] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,296 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 09:10:41,297 DEBUG [RS:0;jenkins-hbase4:46593] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,297 DEBUG [RS:0;jenkins-hbase4:46593] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46593,1689498639060' 2023-07-16 09:10:41,297 DEBUG [RS:0;jenkins-hbase4:46593] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 09:10:41,298 DEBUG [RS:0;jenkins-hbase4:46593] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 09:10:41,299 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 09:10:41,299 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 09:10:41,296 DEBUG [RS:2;jenkins-hbase4:36871] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36871,1689498639173' 2023-07-16 09:10:41,299 DEBUG [RS:0;jenkins-hbase4:46593] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:41,297 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:41,300 DEBUG [RS:0;jenkins-hbase4:46593] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46593,1689498639060' 2023-07-16 09:10:41,300 DEBUG [RS:0;jenkins-hbase4:46593] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:41,299 DEBUG [RS:2;jenkins-hbase4:36871] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 09:10:41,300 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:41,300 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:41,300 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:41,300 DEBUG [RS:0;jenkins-hbase4:46593] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:41,301 DEBUG [RS:2;jenkins-hbase4:36871] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 09:10:41,313 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36871,1689498639173, state=OPENING 2023-07-16 09:10:41,319 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 09:10:41,319 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 09:10:41,319 DEBUG [RS:2;jenkins-hbase4:36871] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,319 DEBUG [RS:2;jenkins-hbase4:36871] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36871,1689498639173' 2023-07-16 09:10:41,319 DEBUG [RS:2;jenkins-hbase4:36871] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:41,319 DEBUG [RS:0;jenkins-hbase4:46593] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 09:10:41,320 INFO [RS:0;jenkins-hbase4:46593] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 09:10:41,331 INFO [RS:0;jenkins-hbase4:46593] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 09:10:41,332 DEBUG [RS:2;jenkins-hbase4:36871] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:41,333 DEBUG [RS:2;jenkins-hbase4:36871] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 09:10:41,333 INFO [RS:2;jenkins-hbase4:36871] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 09:10:41,333 INFO [RS:2;jenkins-hbase4:36871] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 09:10:41,336 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 09:10:41,338 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:41,339 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 09:10:41,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:10:41,397 INFO [RS:1;jenkins-hbase4:34051] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34051%2C1689498639118, suffix=, logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,34051,1689498639118, archiveDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs, maxLogs=32 2023-07-16 09:10:41,427 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK] 2023-07-16 09:10:41,430 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK] 2023-07-16 09:10:41,430 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK] 2023-07-16 09:10:41,436 INFO [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36871%2C1689498639173, suffix=, logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,36871,1689498639173, archiveDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs, maxLogs=32 2023-07-16 09:10:41,437 INFO [RS:0;jenkins-hbase4:46593] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46593%2C1689498639060, suffix=, logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,46593,1689498639060, archiveDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs, maxLogs=32 2023-07-16 09:10:41,463 INFO [RS:1;jenkins-hbase4:34051] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,34051,1689498639118/jenkins-hbase4.apache.org%2C34051%2C1689498639118.1689498641400 2023-07-16 09:10:41,464 DEBUG [RS:1;jenkins-hbase4:34051] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK], DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK], DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK]] 2023-07-16 09:10:41,476 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK] 2023-07-16 09:10:41,485 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK] 2023-07-16 09:10:41,487 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK] 2023-07-16 09:10:41,486 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK] 2023-07-16 09:10:41,491 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK] 2023-07-16 09:10:41,491 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK] 2023-07-16 09:10:41,503 INFO [RS:0;jenkins-hbase4:46593] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,46593,1689498639060/jenkins-hbase4.apache.org%2C46593%2C1689498639060.1689498641451 2023-07-16 09:10:41,506 DEBUG [RS:0;jenkins-hbase4:46593] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK], DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK], DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK]] 2023-07-16 09:10:41,512 INFO [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,36871,1689498639173/jenkins-hbase4.apache.org%2C36871%2C1689498639173.1689498641451 2023-07-16 09:10:41,513 DEBUG [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK], DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK], DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK]] 2023-07-16 09:10:41,565 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:41,569 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:10:41,572 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:10:41,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 09:10:41,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,596 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36871%2C1689498639173.meta, suffix=.meta, logDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,36871,1689498639173, archiveDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs, maxLogs=32 2023-07-16 09:10:41,629 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK] 2023-07-16 09:10:41,636 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK] 2023-07-16 09:10:41,643 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK] 2023-07-16 09:10:41,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/WALs/jenkins-hbase4.apache.org,36871,1689498639173/jenkins-hbase4.apache.org%2C36871%2C1689498639173.meta.1689498641597.meta 2023-07-16 09:10:41,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39341,DS-f6dbb693-020d-4736-a639-6d6751a2e066,DISK], DatanodeInfoWithStorage[127.0.0.1:35841,DS-13dc0342-8b24-4c56-b741-6615f631533a,DISK], DatanodeInfoWithStorage[127.0.0.1:42229,DS-60d7d95f-91aa-4812-93d0-bfbe5196fd09,DISK]] 2023-07-16 09:10:41,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:41,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 09:10:41,670 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:41,671 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 09:10:41,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 09:10:41,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 09:10:41,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 09:10:41,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:41,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 09:10:41,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 09:10:41,699 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 09:10:41,701 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/info 2023-07-16 09:10:41,701 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/info 2023-07-16 09:10:41,702 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 09:10:41,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,706 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 09:10:41,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/rep_barrier 2023-07-16 09:10:41,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/rep_barrier 2023-07-16 09:10:41,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 09:10:41,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,718 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 09:10:41,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/table 2023-07-16 09:10:41,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/table 2023-07-16 09:10:41,722 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 09:10:41,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740 2023-07-16 09:10:41,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740 2023-07-16 09:10:41,733 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 09:10:41,735 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 09:10:41,752 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60842492, jitterRate=-0.09337621927261353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 09:10:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 09:10:41,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689498641555 2023-07-16 09:10:41,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 09:10:41,802 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 09:10:41,803 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36871,1689498639173, state=OPEN 2023-07-16 09:10:41,807 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 09:10:41,807 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 09:10:41,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 09:10:41,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36871,1689498639173 in 463 msec 2023-07-16 09:10:41,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 09:10:41,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 737 msec 2023-07-16 09:10:41,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1230 sec 2023-07-16 09:10:41,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689498641838, completionTime=-1 2023-07-16 09:10:41,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 09:10:41,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 09:10:41,918 DEBUG [hconnection-0x57ac7d77-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:41,922 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:41,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 09:10:41,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689498701944 2023-07-16 09:10:41,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689498761944 2023-07-16 09:10:41,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 105 msec 2023-07-16 09:10:41,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1689498637562-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1689498637562-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1689498637562-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39521, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,985 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 09:10:41,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 09:10:41,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:42,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 09:10:42,013 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:10:42,016 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:10:42,052 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,056 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2 empty. 2023-07-16 09:10:42,057 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,058 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 09:10:42,158 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:42,161 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6833dbe3eacfd58d8702f764ccd702d2, NAME => 'hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:10:42,198 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:42,198 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6833dbe3eacfd58d8702f764ccd702d2, disabling compactions & flushes 2023-07-16 09:10:42,198 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,198 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. after waiting 0 ms 2023-07-16 09:10:42,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,199 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6833dbe3eacfd58d8702f764ccd702d2: 2023-07-16 09:10:42,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:10:42,222 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689498642208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498642208"}]},"ts":"1689498642208"} 2023-07-16 09:10:42,256 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 09:10:42,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:10:42,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498642258"}]},"ts":"1689498642258"} 2023-07-16 09:10:42,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 09:10:42,271 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:42,273 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:42,273 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:42,273 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:42,273 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:42,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6833dbe3eacfd58d8702f764ccd702d2, ASSIGN}] 2023-07-16 09:10:42,280 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6833dbe3eacfd58d8702f764ccd702d2, ASSIGN 2023-07-16 09:10:42,282 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6833dbe3eacfd58d8702f764ccd702d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:10:42,434 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 09:10:42,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6833dbe3eacfd58d8702f764ccd702d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:42,436 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689498642435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498642435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498642435"}]},"ts":"1689498642435"} 2023-07-16 09:10:42,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6833dbe3eacfd58d8702f764ccd702d2, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:10:42,598 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:42,599 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:10:42,603 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:10:42,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6833dbe3eacfd58d8702f764ccd702d2, NAME => 'hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:42,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. service=AccessControlService 2023-07-16 09:10:42,617 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:42,618 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,618 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:42,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,622 INFO [StoreOpener-6833dbe3eacfd58d8702f764ccd702d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,625 DEBUG [StoreOpener-6833dbe3eacfd58d8702f764ccd702d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/info 2023-07-16 09:10:42,625 DEBUG [StoreOpener-6833dbe3eacfd58d8702f764ccd702d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/info 2023-07-16 09:10:42,626 INFO [StoreOpener-6833dbe3eacfd58d8702f764ccd702d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6833dbe3eacfd58d8702f764ccd702d2 columnFamilyName info 2023-07-16 09:10:42,627 INFO [StoreOpener-6833dbe3eacfd58d8702f764ccd702d2-1] regionserver.HStore(310): Store=6833dbe3eacfd58d8702f764ccd702d2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:42,629 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:10:42,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:42,645 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6833dbe3eacfd58d8702f764ccd702d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59343459, jitterRate=-0.11571355164051056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:42,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6833dbe3eacfd58d8702f764ccd702d2: 2023-07-16 09:10:42,648 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2., pid=6, masterSystemTime=1689498642598 2023-07-16 09:10:42,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:10:42,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6833dbe3eacfd58d8702f764ccd702d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:42,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689498642655"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498642655"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498642655"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498642655"}]},"ts":"1689498642655"} 2023-07-16 09:10:42,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 09:10:42,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6833dbe3eacfd58d8702f764ccd702d2, server=jenkins-hbase4.apache.org,34051,1689498639118 in 219 msec 2023-07-16 09:10:42,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 09:10:42,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6833dbe3eacfd58d8702f764ccd702d2, ASSIGN in 390 msec 2023-07-16 09:10:42,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:10:42,672 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498642672"}]},"ts":"1689498642672"} 2023-07-16 09:10:42,677 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 09:10:42,691 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:10:42,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 694 msec 2023-07-16 09:10:42,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 09:10:42,714 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 09:10:42,714 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:42,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:42,740 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:42,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 09:10:42,776 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 09:10:42,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-16 09:10:42,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 09:10:42,812 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 09:10:42,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-16 09:10:42,838 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 09:10:42,841 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 09:10:42,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.534sec 2023-07-16 09:10:42,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 09:10:42,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 09:10:42,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 09:10:42,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1689498637562-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 09:10:42,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1689498637562-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 09:10:42,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:42,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 09:10:42,887 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:10:42,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:10:42,889 DEBUG [Listener at localhost/43761] zookeeper.ReadOnlyZKClient(139): Connect 0x40bb1f00 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:42,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 09:10:42,895 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/acl/f645c4baf35786e6438275311f40f057 2023-07-16 09:10:42,896 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/acl/f645c4baf35786e6438275311f40f057 empty. 2023-07-16 09:10:42,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/acl/f645c4baf35786e6438275311f40f057 2023-07-16 09:10:42,899 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 09:10:42,900 DEBUG [Listener at localhost/43761] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@695cdb1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:42,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:42,928 DEBUG [hconnection-0x60bfaa6c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:42,948 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:42,949 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:42,951 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f645c4baf35786e6438275311f40f057, NAME => 'hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:10:42,953 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:10:42,953 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 09:10:42,953 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/test.cache.data in system properties and HBase conf 2023-07-16 09:10:42,953 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 09:10:42,953 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop.log.dir in system properties and HBase conf 2023-07-16 09:10:42,954 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 09:10:42,954 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 09:10:42,954 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 09:10:42,954 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:42,954 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:42,954 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 09:10:42,955 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/nfs.dump.dir in system properties and HBase conf 2023-07-16 09:10:42,956 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir in system properties and HBase conf 2023-07-16 09:10:42,956 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:42,956 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 09:10:42,956 INFO [Listener at localhost/43761] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 09:10:42,993 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:42,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f645c4baf35786e6438275311f40f057, disabling compactions & flushes 2023-07-16 09:10:42,994 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:42,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:42,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. after waiting 0 ms 2023-07-16 09:10:42,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:42,994 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:42,994 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f645c4baf35786e6438275311f40f057: 2023-07-16 09:10:43,004 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:10:43,007 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689498643006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498643006"}]},"ts":"1689498643006"} 2023-07-16 09:10:43,012 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 09:10:43,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,014 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:10:43,014 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498643014"}]},"ts":"1689498643014"} 2023-07-16 09:10:43,017 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 09:10:43,035 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:43,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:43,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:43,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:43,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:43,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f645c4baf35786e6438275311f40f057, ASSIGN}] 2023-07-16 09:10:43,041 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f645c4baf35786e6438275311f40f057, ASSIGN 2023-07-16 09:10:43,044 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f645c4baf35786e6438275311f40f057, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:10:43,195 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 09:10:43,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f645c4baf35786e6438275311f40f057, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:43,197 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689498643197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498643197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498643197"}]},"ts":"1689498643197"} 2023-07-16 09:10:43,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f645c4baf35786e6438275311f40f057, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:10:43,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,367 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:43,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f645c4baf35786e6438275311f40f057, NAME => 'hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. service=AccessControlService 2023-07-16 09:10:43,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,372 INFO [StoreOpener-f645c4baf35786e6438275311f40f057-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,375 DEBUG [StoreOpener-f645c4baf35786e6438275311f40f057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/l 2023-07-16 09:10:43,375 DEBUG [StoreOpener-f645c4baf35786e6438275311f40f057-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/l 2023-07-16 09:10:43,376 INFO [StoreOpener-f645c4baf35786e6438275311f40f057-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f645c4baf35786e6438275311f40f057 columnFamilyName l 2023-07-16 09:10:43,377 INFO [StoreOpener-f645c4baf35786e6438275311f40f057-1] regionserver.HStore(310): Store=f645c4baf35786e6438275311f40f057/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:43,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f645c4baf35786e6438275311f40f057 2023-07-16 09:10:43,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:43,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f645c4baf35786e6438275311f40f057; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73273712, jitterRate=0.09186339378356934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:43,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f645c4baf35786e6438275311f40f057: 2023-07-16 09:10:43,395 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057., pid=11, masterSystemTime=1689498643359 2023-07-16 09:10:43,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:43,400 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:10:43,401 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f645c4baf35786e6438275311f40f057, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:43,401 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689498643401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498643401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498643401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498643401"}]},"ts":"1689498643401"} 2023-07-16 09:10:43,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 09:10:43,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f645c4baf35786e6438275311f40f057, server=jenkins-hbase4.apache.org,34051,1689498639118 in 199 msec 2023-07-16 09:10:43,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 09:10:43,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f645c4baf35786e6438275311f40f057, ASSIGN in 371 msec 2023-07-16 09:10:43,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:10:43,416 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498643416"}]},"ts":"1689498643416"} 2023-07-16 09:10:43,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 09:10:43,423 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:10:43,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 545 msec 2023-07-16 09:10:43,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 09:10:43,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 09:10:44,365 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:44,668 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:44,674 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36577_jobhistory____.hbs3b9/webapp 2023-07-16 09:10:44,831 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 09:10:44,831 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:44,831 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:44,834 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:44,907 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:45,187 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:45,506 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 09:10:45,590 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36577 2023-07-16 09:10:45,863 WARN [Listener at jenkins-hbase4.apache.org/42429] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:46,252 WARN [Listener at jenkins-hbase4.apache.org/42429] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 09:10:46,253 INFO [Listener at jenkins-hbase4.apache.org/42429] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:46,266 INFO [Listener at jenkins-hbase4.apache.org/42429] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42561_cluster____iycrn6/webapp 2023-07-16 09:10:46,345 INFO [Listener at jenkins-hbase4.apache.org/42429] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:46,345 INFO [Listener at jenkins-hbase4.apache.org/42429] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 09:10:46,345 INFO [Listener at jenkins-hbase4.apache.org/42429] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:46,346 INFO [Listener at jenkins-hbase4.apache.org/42429] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:46,357 INFO [Listener at jenkins-hbase4.apache.org/42429] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:46,568 INFO [Listener at jenkins-hbase4.apache.org/42429] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:46,803 INFO [Listener at jenkins-hbase4.apache.org/42429] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:46,864 INFO [Listener at jenkins-hbase4.apache.org/42429] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42561 2023-07-16 09:10:47,420 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:10:47,600 WARN [Listener at jenkins-hbase4.apache.org/44983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:47,625 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 09:10:47,635 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 09:10:47,636 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 09:10:47,646 WARN [Listener at jenkins-hbase4.apache.org/44983] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 09:10:47,647 INFO [Listener at jenkins-hbase4.apache.org/44983] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:47,670 INFO [Listener at jenkins-hbase4.apache.org/44983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34729_node____2v8bgb/webapp 2023-07-16 09:10:47,747 INFO [Listener at jenkins-hbase4.apache.org/44983] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 09:10:47,747 INFO [Listener at jenkins-hbase4.apache.org/44983] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:47,747 INFO [Listener at jenkins-hbase4.apache.org/44983] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:47,747 INFO [Listener at jenkins-hbase4.apache.org/44983] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:47,757 INFO [Listener at jenkins-hbase4.apache.org/44983] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:47,768 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:10:47,769 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 09:10:47,769 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:10:47,769 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 09:10:47,770 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 09:10:47,770 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 09:10:47,770 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:10:47,770 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 09:10:47,770 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 09:10:47,770 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 09:10:47,785 INFO [Listener at jenkins-hbase4.apache.org/44983] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:47,895 INFO [Listener at jenkins-hbase4.apache.org/44983] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:47,927 INFO [Listener at jenkins-hbase4.apache.org/44983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34729 2023-07-16 09:10:48,206 WARN [Listener at jenkins-hbase4.apache.org/46737] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:48,214 WARN [Listener at jenkins-hbase4.apache.org/46737] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 09:10:48,214 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:48,225 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38443_node____.apk87o/webapp 2023-07-16 09:10:48,303 INFO [Listener at jenkins-hbase4.apache.org/46737] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 09:10:48,303 INFO [Listener at jenkins-hbase4.apache.org/46737] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:48,303 INFO [Listener at jenkins-hbase4.apache.org/46737] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:48,303 INFO [Listener at jenkins-hbase4.apache.org/46737] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:48,314 INFO [Listener at jenkins-hbase4.apache.org/46737] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:48,332 INFO [Listener at jenkins-hbase4.apache.org/46737] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:48,410 INFO [Listener at jenkins-hbase4.apache.org/46737] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:48,432 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38443 2023-07-16 09:10:48,464 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 09:10:48,466 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:48,535 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=175, AvailableMemoryMB=4607 2023-07-16 09:10:48,535 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-16 09:10:48,548 DEBUG [Listener at jenkins-hbase4.apache.org/46737] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 09:10:48,554 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 09:10:48,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:48,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:10:48,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:10:48,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 09:10:48,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:48,569 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:10:48,574 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:48,574 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:48,576 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 empty. 2023-07-16 09:10:48,577 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 empty. 2023-07-16 09:10:48,578 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:48,578 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:48,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 09:10:48,622 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:48,626 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => bcfff0b2f5e2faba262aa56ed0eb0101, NAME => 'testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:10:48,626 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 42a2bdd725fd41db0c2032442a94f336, NAME => 'testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:10:48,664 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:48,664 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:48,667 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing bcfff0b2f5e2faba262aa56ed0eb0101, disabling compactions & flushes 2023-07-16 09:10:48,667 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 42a2bdd725fd41db0c2032442a94f336, disabling compactions & flushes 2023-07-16 09:10:48,667 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:48,667 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. after waiting 0 ms 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:48,667 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:48,668 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. after waiting 0 ms 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for bcfff0b2f5e2faba262aa56ed0eb0101: 2023-07-16 09:10:48,668 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:48,668 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 42a2bdd725fd41db0c2032442a94f336: 2023-07-16 09:10:48,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:48,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:10:48,677 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498648676"}]},"ts":"1689498648676"} 2023-07-16 09:10:48,677 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498648676"}]},"ts":"1689498648676"} 2023-07-16 09:10:48,735 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:10:48,736 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:10:48,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498648737"}]},"ts":"1689498648737"} 2023-07-16 09:10:48,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 09:10:48,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:48,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:48,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:48,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:48,748 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:48,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, ASSIGN}] 2023-07-16 09:10:48,751 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, ASSIGN 2023-07-16 09:10:48,751 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, ASSIGN 2023-07-16 09:10:48,753 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46593,1689498639060; forceNewPlan=false, retain=false 2023-07-16 09:10:48,753 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:10:48,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:48,903 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:10:48,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bcfff0b2f5e2faba262aa56ed0eb0101, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:48,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=42a2bdd725fd41db0c2032442a94f336, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:48,906 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498648905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498648905"}]},"ts":"1689498648905"} 2023-07-16 09:10:48,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498648905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498648905"}]},"ts":"1689498648905"} 2023-07-16 09:10:48,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure bcfff0b2f5e2faba262aa56ed0eb0101, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:10:48,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 42a2bdd725fd41db0c2032442a94f336, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:10:49,063 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:49,063 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:10:49,067 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:10:49,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:49,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bcfff0b2f5e2faba262aa56ed0eb0101, NAME => 'testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42a2bdd725fd41db0c2032442a94f336, NAME => 'testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. service=AccessControlService 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. service=AccessControlService 2023-07-16 09:10:49,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:49,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,076 INFO [StoreOpener-bcfff0b2f5e2faba262aa56ed0eb0101-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,076 INFO [StoreOpener-42a2bdd725fd41db0c2032442a94f336-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,078 DEBUG [StoreOpener-42a2bdd725fd41db0c2032442a94f336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf 2023-07-16 09:10:49,078 DEBUG [StoreOpener-42a2bdd725fd41db0c2032442a94f336-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf 2023-07-16 09:10:49,078 DEBUG [StoreOpener-bcfff0b2f5e2faba262aa56ed0eb0101-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf 2023-07-16 09:10:49,078 DEBUG [StoreOpener-bcfff0b2f5e2faba262aa56ed0eb0101-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf 2023-07-16 09:10:49,078 INFO [StoreOpener-42a2bdd725fd41db0c2032442a94f336-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42a2bdd725fd41db0c2032442a94f336 columnFamilyName cf 2023-07-16 09:10:49,078 INFO [StoreOpener-bcfff0b2f5e2faba262aa56ed0eb0101-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcfff0b2f5e2faba262aa56ed0eb0101 columnFamilyName cf 2023-07-16 09:10:49,079 INFO [StoreOpener-42a2bdd725fd41db0c2032442a94f336-1] regionserver.HStore(310): Store=42a2bdd725fd41db0c2032442a94f336/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:49,079 INFO [StoreOpener-bcfff0b2f5e2faba262aa56ed0eb0101-1] regionserver.HStore(310): Store=bcfff0b2f5e2faba262aa56ed0eb0101/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:10:49,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:10:49,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:49,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:49,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bcfff0b2f5e2faba262aa56ed0eb0101; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63856395, jitterRate=-0.04846556484699249}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:49,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bcfff0b2f5e2faba262aa56ed0eb0101: 2023-07-16 09:10:49,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42a2bdd725fd41db0c2032442a94f336; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75038297, jitterRate=0.118157759308815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:49,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42a2bdd725fd41db0c2032442a94f336: 2023-07-16 09:10:49,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336., pid=16, masterSystemTime=1689498649064 2023-07-16 09:10:49,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101., pid=15, masterSystemTime=1689498649063 2023-07-16 09:10:49,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:49,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:49,104 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=42a2bdd725fd41db0c2032442a94f336, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:49,105 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498649104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498649104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498649104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498649104"}]},"ts":"1689498649104"} 2023-07-16 09:10:49,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:49,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:49,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bcfff0b2f5e2faba262aa56ed0eb0101, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:49,109 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498649108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498649108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498649108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498649108"}]},"ts":"1689498649108"} 2023-07-16 09:10:49,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-16 09:10:49,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 42a2bdd725fd41db0c2032442a94f336, server=jenkins-hbase4.apache.org,34051,1689498639118 in 201 msec 2023-07-16 09:10:49,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-16 09:10:49,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure bcfff0b2f5e2faba262aa56ed0eb0101, server=jenkins-hbase4.apache.org,46593,1689498639060 in 206 msec 2023-07-16 09:10:49,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, ASSIGN in 368 msec 2023-07-16 09:10:49,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-16 09:10:49,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, ASSIGN in 374 msec 2023-07-16 09:10:49,133 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:10:49,133 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498649133"}]},"ts":"1689498649133"} 2023-07-16 09:10:49,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 09:10:49,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:10:49,146 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 09:10:49,159 DEBUG [hconnection-0x7033f751-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,163 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,173 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 09:10:49,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:49,212 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,213 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,213 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:49,213 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,212 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 663 msec 2023-07-16 09:10:49,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:49,679 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 09:10:49,680 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-16 09:10:49,681 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:49,685 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-16 09:10:49,686 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:49,686 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-16 09:10:49,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:49,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498649700 (current time:1689498649700). 2023-07-16 09:10:49,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:10:49,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x70f16ea8 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:49,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e280fb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:49,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,712 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70f16ea8 to 127.0.0.1:59352 2023-07-16 09:10:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:49,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x7b1c7673 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:49,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15986b8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:49,724 DEBUG [hconnection-0x4b421f01-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,727 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,732 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b1c7673 to 127.0.0.1:59352 2023-07-16 09:10:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 09:10:49,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:10:49,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:49,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:49,786 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:49,787 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689499249787 2023-07-16 09:10:49,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:49,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 09:10:49,790 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:49,795 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:10:49,795 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:10:49,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:49,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-16 09:10:49,799 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:49,800 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689499249800 2023-07-16 09:10:49,895 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:49,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:49,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:49,900 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:10:50,100 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:50,102 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:10:50,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,238 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 09:10:50,238 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,238 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 09:10:50,238 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 09:10:50,239 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,239 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,246 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,246 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,246 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,246 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,247 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,247 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,248 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,248 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:50,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:50,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,257 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:50,258 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:50,258 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:50,258 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:50,258 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:50,258 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,258 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:50,259 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:50,259 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:50,259 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:50,262 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,263 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e24d7bf[Count = 1] remaining members to acquire global barrier 2023-07-16 09:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:50,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e24d7bf[Count = 0] remaining members to acquire global barrier 2023-07-16 09:10:50,271 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 09:10:50,271 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,273 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,273 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,273 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,274 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:50,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:10:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:50,279 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:50,279 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:50,279 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,279 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:10:50,279 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. started... 2023-07-16 09:10:50,279 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. started... 2023-07-16 09:10:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,284 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bcfff0b2f5e2faba262aa56ed0eb0101: 2023-07-16 09:10:50,284 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42a2bdd725fd41db0c2032442a94f336: 2023-07-16 09:10:50,286 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,286 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,293 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:50,293 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:50,299 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:10:50,299 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:10:50,333 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. completed. 2023-07-16 09:10:50,333 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:50,333 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. completed. 2023-07-16 09:10:50,333 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:50,333 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:50,333 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:50,333 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:50,333 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:10:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:10:50,336 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,336 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,336 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,336 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,336 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,337 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,336 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:10:50,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 09:10:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:10:50,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 09:10:50,347 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 09:10:50,347 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:10:50,347 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:10:50,347 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,347 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,351 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,352 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,353 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,365 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,366 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,367 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,382 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,382 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,382 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,383 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,383 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,383 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,383 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,383 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,384 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,384 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,402 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:50,406 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:10:50,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 09:10:50,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,511 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689498649788Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689498650383 (+595 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689498650384 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689498650402 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689498650429 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689498650510 (+81 ms) 2023-07-16 09:10:50,515 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:50,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 726 msec 2023-07-16 09:10:50,906 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:10:50,948 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:50,948 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:50,968 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:50,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34051] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:10:50,983 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:50,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46593] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:10:50,996 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 09:10:50,998 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:51,001 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:51,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:51,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498651040 (current time:1689498651040). 2023-07-16 09:10:51,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:10:51,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x7f341e92 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:51,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e90fa57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:51,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:51,070 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:51,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f341e92 to 127.0.0.1:59352 2023-07-16 09:10:51,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:51,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x649daa72 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:51,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b02f8fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:51,108 DEBUG [hconnection-0x12e9ef88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:51,113 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:51,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:51,124 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:51,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x649daa72 to 127.0.0.1:59352 2023-07-16 09:10:51,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:51,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 09:10:51,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:10:51,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:51,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:51,132 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:51,135 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689499251135 2023-07-16 09:10:51,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 09:10:51,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:51,137 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:10:51,137 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:10:51,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:51,142 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:51,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-16 09:10:51,147 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:51,149 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689499251149 2023-07-16 09:10:51,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 09:10:51,196 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 09:10:51,196 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:51,197 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 09:10:51,197 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 09:10:51,198 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,198 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,200 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,201 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,200 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,201 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,202 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,202 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,202 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,202 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:10:51,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 09:10:51,203 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 09:10:51,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 09:10:51,203 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:51,204 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:51,203 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:51,205 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:51,207 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:51,207 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:51,203 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:51,207 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:51,207 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:51,210 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:51,210 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:51,208 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:51,214 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:51,214 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,218 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,219 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:51,219 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,219 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:51,220 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,220 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,221 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,221 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:51,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:51,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@321f3b3e[Count = 1] remaining members to acquire global barrier 2023-07-16 09:10:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:51,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@321f3b3e[Count = 0] remaining members to acquire global barrier 2023-07-16 09:10:51,230 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 09:10:51,230 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,236 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,236 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,237 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:51,237 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:51,237 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,237 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,237 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:51,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,238 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:51,238 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:51,238 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:10:51,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:51,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:51,241 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:10:51,242 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:51,243 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:51,246 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. started... 2023-07-16 09:10:51,246 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,246 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:10:51,246 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bcfff0b2f5e2faba262aa56ed0eb0101 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 09:10:51,247 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:51,247 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:51,247 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:51,246 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:51,247 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:51,249 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:51,249 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. started... 2023-07-16 09:10:51,250 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42a2bdd725fd41db0c2032442a94f336 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 09:10:51,372 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/.tmp/cf/41faffe74ac84236846a8a7bedfcb150 2023-07-16 09:10:51,380 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/.tmp/cf/5f3d1ef935ab43dea655b494fe0e0815 2023-07-16 09:10:51,426 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/.tmp/cf/41faffe74ac84236846a8a7bedfcb150 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf/41faffe74ac84236846a8a7bedfcb150 2023-07-16 09:10:51,426 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/.tmp/cf/5f3d1ef935ab43dea655b494fe0e0815 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf/5f3d1ef935ab43dea655b494fe0e0815 2023-07-16 09:10:51,441 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:51,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:51,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:51,449 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf/5f3d1ef935ab43dea655b494fe0e0815, entries=3, sequenceid=6, filesize=5.0 K 2023-07-16 09:10:51,449 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:10:51,450 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf/41faffe74ac84236846a8a7bedfcb150, entries=47, sequenceid=6, filesize=8 K 2023-07-16 09:10:51,455 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for bcfff0b2f5e2faba262aa56ed0eb0101 in 209ms, sequenceid=6, compaction requested=false 2023-07-16 09:10:51,455 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 42a2bdd725fd41db0c2032442a94f336 in 206ms, sequenceid=6, compaction requested=false 2023-07-16 09:10:51,455 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 09:10:51,456 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 09:10:51,458 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bcfff0b2f5e2faba262aa56ed0eb0101: 2023-07-16 09:10:51,459 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,459 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:51,459 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf/5f3d1ef935ab43dea655b494fe0e0815] hfiles 2023-07-16 09:10:51,459 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf/5f3d1ef935ab43dea655b494fe0e0815 for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,464 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42a2bdd725fd41db0c2032442a94f336: 2023-07-16 09:10:51,464 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,464 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:51,464 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf/41faffe74ac84236846a8a7bedfcb150] hfiles 2023-07-16 09:10:51,464 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf/41faffe74ac84236846a8a7bedfcb150 for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,501 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. completed. 2023-07-16 09:10:51,501 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:10:51,501 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:51,502 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:51,502 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,502 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:51,502 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:10:51,505 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,505 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,505 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:51,505 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:51,508 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. completed. 2023-07-16 09:10:51,508 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:10:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:10:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,510 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:51,510 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,510 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:51,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,510 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:51,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:10:51,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 09:10:51,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:10:51,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 09:10:51,521 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 09:10:51,521 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:10:51,521 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:10:51,521 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 09:10:51,521 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:10:51,524 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,524 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,524 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,525 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,527 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,527 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,527 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,528 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,533 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,533 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,534 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,554 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,555 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,556 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:51,556 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 09:10:51,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 09:10:51,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,677 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 09:10:51,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,678 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689498651135Consolidate snapshot: snaptb0-testExportWithTargetName at 1689498651556 (+421 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689498651558 (+2 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689498651570 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689498651611 (+41 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689498651677 (+66 ms) 2023-07-16 09:10:51,679 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:51,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 542 msec 2023-07-16 09:10:51,749 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:51,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:51,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:10:51,754 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754 2023-07-16 09:10:51,754 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33301, tgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754, rawTgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:10:51,798 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:10:51,798 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-730999638_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 09:10:51,798 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 09:10:51,815 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 09:10:51,885 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,885 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,886 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,887 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,887 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,887 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,977 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-6140904722542237231.jar 2023-07-16 09:10:51,978 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,979 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,979 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,980 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,980 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,981 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,981 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:10:51,982 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:10:51,983 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:10:51,983 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:10:51,984 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:10:51,985 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:10:51,985 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:10:51,986 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:10:51,986 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:10:51,987 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:10:51,991 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,992 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,992 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:10:51,993 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,993 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,994 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:10:51,994 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:10:53,817 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:10:53,824 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 09:10:53,835 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 09:10:54,307 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:10:54,308 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:10:54,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:10:54,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0001_000001 (auth:SIMPLE) 2023-07-16 09:10:59,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:02,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:05,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:07,754 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:07,757 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:07,768 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 09:11:07,769 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:07,769 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:07,770 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 09:11:07,770 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 09:11:07,770 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 09:11:07,771 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754/.hbase-snapshot/testExportWithTargetName 2023-07-16 09:11:07,771 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 09:11:07,771 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498651754/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 09:11:07,784 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 09:11:07,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 09:11:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498667803"}]},"ts":"1689498667803"} 2023-07-16 09:11:07,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 09:11:07,805 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 09:11:07,807 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 09:11:07,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, UNASSIGN}] 2023-07-16 09:11:07,812 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, UNASSIGN 2023-07-16 09:11:07,813 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, UNASSIGN 2023-07-16 09:11:07,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=42a2bdd725fd41db0c2032442a94f336, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:07,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498667816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498667816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498667816"}]},"ts":"1689498667816"} 2023-07-16 09:11:07,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=bcfff0b2f5e2faba262aa56ed0eb0101, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:07,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498667817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498667817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498667817"}]},"ts":"1689498667817"} 2023-07-16 09:11:07,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 42a2bdd725fd41db0c2032442a94f336, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:11:07,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure bcfff0b2f5e2faba262aa56ed0eb0101, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:11:07,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 09:11:07,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:11:07,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:11:07,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bcfff0b2f5e2faba262aa56ed0eb0101, disabling compactions & flushes 2023-07-16 09:11:07,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42a2bdd725fd41db0c2032442a94f336, disabling compactions & flushes 2023-07-16 09:11:07,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:11:07,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:11:07,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:11:07,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:11:07,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. after waiting 0 ms 2023-07-16 09:11:07,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. after waiting 0 ms 2023-07-16 09:11:07,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:11:07,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:11:07,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:08,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:08,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:08,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:08,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101. 2023-07-16 09:11:08,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bcfff0b2f5e2faba262aa56ed0eb0101: 2023-07-16 09:11:08,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336. 2023-07-16 09:11:08,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42a2bdd725fd41db0c2032442a94f336: 2023-07-16 09:11:08,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:11:08,005 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=bcfff0b2f5e2faba262aa56ed0eb0101, regionState=CLOSED 2023-07-16 09:11:08,005 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498668005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498668005"}]},"ts":"1689498668005"} 2023-07-16 09:11:08,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:11:08,006 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=42a2bdd725fd41db0c2032442a94f336, regionState=CLOSED 2023-07-16 09:11:08,006 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498668006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498668006"}]},"ts":"1689498668006"} 2023-07-16 09:11:08,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 09:11:08,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 42a2bdd725fd41db0c2032442a94f336, server=jenkins-hbase4.apache.org,34051,1689498639118 in 190 msec 2023-07-16 09:11:08,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 09:11:08,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure bcfff0b2f5e2faba262aa56ed0eb0101, server=jenkins-hbase4.apache.org,46593,1689498639060 in 186 msec 2023-07-16 09:11:08,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42a2bdd725fd41db0c2032442a94f336, UNASSIGN in 204 msec 2023-07-16 09:11:08,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-16 09:11:08,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcfff0b2f5e2faba262aa56ed0eb0101, UNASSIGN in 204 msec 2023-07-16 09:11:08,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498668017"}]},"ts":"1689498668017"} 2023-07-16 09:11:08,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 09:11:08,021 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 09:11:08,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 228 msec 2023-07-16 09:11:08,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 09:11:08,108 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 09:11:08,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 09:11:08,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:08,124 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:08,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 09:11:08,126 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:08,129 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 09:11:08,132 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:11:08,132 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:11:08,133 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:08,133 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:08,133 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:08,134 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:08,135 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 09:11:08,135 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 09:11:08,135 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:11:08,135 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,135 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,135 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:11:08,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 09:11:08,136 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:11:08,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 09:11:08,136 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:11:08,137 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/recovered.edits] 2023-07-16 09:11:08,137 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/recovered.edits] 2023-07-16 09:11:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 09:11:08,146 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf/5f3d1ef935ab43dea655b494fe0e0815 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/cf/5f3d1ef935ab43dea655b494fe0e0815 2023-07-16 09:11:08,146 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf/41faffe74ac84236846a8a7bedfcb150 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/cf/41faffe74ac84236846a8a7bedfcb150 2023-07-16 09:11:08,151 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101/recovered.edits/9.seqid 2023-07-16 09:11:08,151 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336/recovered.edits/9.seqid 2023-07-16 09:11:08,152 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/bcfff0b2f5e2faba262aa56ed0eb0101 2023-07-16 09:11:08,152 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportWithTargetName/42a2bdd725fd41db0c2032442a94f336 2023-07-16 09:11:08,153 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 09:11:08,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:08,176 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 09:11:08,179 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 09:11:08,180 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:08,180 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 09:11:08,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498668180"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:08,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498668180"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:08,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:11:08,182 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bcfff0b2f5e2faba262aa56ed0eb0101, NAME => 'testtb-testExportWithTargetName,,1689498648561.bcfff0b2f5e2faba262aa56ed0eb0101.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 42a2bdd725fd41db0c2032442a94f336, NAME => 'testtb-testExportWithTargetName,1,1689498648561.42a2bdd725fd41db0c2032442a94f336.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:11:08,182 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 09:11:08,183 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498668183"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:08,184 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 09:11:08,187 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:08,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 73 msec 2023-07-16 09:11:08,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 09:11:08,240 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 09:11:08,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 09:11:08,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 09:11:08,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 09:11:08,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 09:11:08,303 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=759 (was 708) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:42178 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1591910152_1 at /127.0.0.1:34844 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:44983 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:36897 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:34864 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:40965 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:45866 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1591910152_1 at /127.0.0.1:42166 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=453 (was 369) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=2800 (was 4607) 2023-07-16 09:11:08,303 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-16 09:11:08,334 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=759, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=453, ProcessCount=181, AvailableMemoryMB=2800 2023-07-16 09:11:08,334 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-16 09:11:08,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:11:08,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:08,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:11:08,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 09:11:08,344 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:11:08,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,346 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,346 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,347 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 empty. 2023-07-16 09:11:08,347 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a empty. 2023-07-16 09:11:08,347 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,347 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 09:11:08,364 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 09:11:08,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9435a716c06bd3a009727d6cfba855f6, NAME => 'testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:11:08,366 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e771bea2f7367716c17721a7f579622a, NAME => 'testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:11:08,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:08,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e771bea2f7367716c17721a7f579622a, disabling compactions & flushes 2023-07-16 09:11:08,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. after waiting 0 ms 2023-07-16 09:11:08,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e771bea2f7367716c17721a7f579622a: 2023-07-16 09:11:08,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:08,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9435a716c06bd3a009727d6cfba855f6, disabling compactions & flushes 2023-07-16 09:11:08,385 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. after waiting 0 ms 2023-07-16 09:11:08,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,385 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9435a716c06bd3a009727d6cfba855f6: 2023-07-16 09:11:08,388 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:11:08,389 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498668389"}]},"ts":"1689498668389"} 2023-07-16 09:11:08,389 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498668389"}]},"ts":"1689498668389"} 2023-07-16 09:11:08,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:11:08,393 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:11:08,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498668393"}]},"ts":"1689498668393"} 2023-07-16 09:11:08,394 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 09:11:08,398 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:11:08,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:11:08,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:11:08,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:11:08,400 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:11:08,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, ASSIGN}] 2023-07-16 09:11:08,402 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, ASSIGN 2023-07-16 09:11:08,403 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, ASSIGN 2023-07-16 09:11:08,403 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:11:08,403 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36871,1689498639173; forceNewPlan=false, retain=false 2023-07-16 09:11:08,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,554 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:11:08,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9435a716c06bd3a009727d6cfba855f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:08,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e771bea2f7367716c17721a7f579622a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:08,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498668557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498668557"}]},"ts":"1689498668557"} 2023-07-16 09:11:08,558 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498668557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498668557"}]},"ts":"1689498668557"} 2023-07-16 09:11:08,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e771bea2f7367716c17721a7f579622a, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:11:08,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9435a716c06bd3a009727d6cfba855f6, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:11:08,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e771bea2f7367716c17721a7f579622a, NAME => 'testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:11:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. service=AccessControlService 2023-07-16 09:11:08,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:08,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9435a716c06bd3a009727d6cfba855f6, NAME => 'testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:11:08,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. service=AccessControlService 2023-07-16 09:11:08,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:08,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:08,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,726 INFO [StoreOpener-e771bea2f7367716c17721a7f579622a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,727 INFO [StoreOpener-9435a716c06bd3a009727d6cfba855f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,728 DEBUG [StoreOpener-e771bea2f7367716c17721a7f579622a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf 2023-07-16 09:11:08,728 DEBUG [StoreOpener-e771bea2f7367716c17721a7f579622a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf 2023-07-16 09:11:08,728 INFO [StoreOpener-e771bea2f7367716c17721a7f579622a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e771bea2f7367716c17721a7f579622a columnFamilyName cf 2023-07-16 09:11:08,728 DEBUG [StoreOpener-9435a716c06bd3a009727d6cfba855f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf 2023-07-16 09:11:08,728 DEBUG [StoreOpener-9435a716c06bd3a009727d6cfba855f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf 2023-07-16 09:11:08,729 INFO [StoreOpener-9435a716c06bd3a009727d6cfba855f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9435a716c06bd3a009727d6cfba855f6 columnFamilyName cf 2023-07-16 09:11:08,729 INFO [StoreOpener-e771bea2f7367716c17721a7f579622a-1] regionserver.HStore(310): Store=e771bea2f7367716c17721a7f579622a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:08,731 INFO [StoreOpener-9435a716c06bd3a009727d6cfba855f6-1] regionserver.HStore(310): Store=9435a716c06bd3a009727d6cfba855f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:08,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:08,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:08,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:08,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e771bea2f7367716c17721a7f579622a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69489393, jitterRate=0.03547264635562897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:08,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e771bea2f7367716c17721a7f579622a: 2023-07-16 09:11:08,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:08,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a., pid=30, masterSystemTime=1689498668715 2023-07-16 09:11:08,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9435a716c06bd3a009727d6cfba855f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73051495, jitterRate=0.08855210244655609}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:08,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9435a716c06bd3a009727d6cfba855f6: 2023-07-16 09:11:08,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6., pid=31, masterSystemTime=1689498668716 2023-07-16 09:11:08,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:08,747 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e771bea2f7367716c17721a7f579622a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:08,747 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668747"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498668747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498668747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498668747"}]},"ts":"1689498668747"} 2023-07-16 09:11:08,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:08,749 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9435a716c06bd3a009727d6cfba855f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:08,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498668749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498668749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498668749"}]},"ts":"1689498668749"} 2023-07-16 09:11:08,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-16 09:11:08,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e771bea2f7367716c17721a7f579622a, server=jenkins-hbase4.apache.org,34051,1689498639118 in 190 msec 2023-07-16 09:11:08,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-16 09:11:08,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9435a716c06bd3a009727d6cfba855f6, server=jenkins-hbase4.apache.org,36871,1689498639173 in 191 msec 2023-07-16 09:11:08,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, ASSIGN in 355 msec 2023-07-16 09:11:08,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-16 09:11:08,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, ASSIGN in 360 msec 2023-07-16 09:11:08,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:11:08,766 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498668766"}]},"ts":"1689498668766"} 2023-07-16 09:11:08,768 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 09:11:08,773 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:11:08,773 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 09:11:08,777 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:11:08,779 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,779 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,779 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,779 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 442 msec 2023-07-16 09:11:08,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,948 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 09:11:08,948 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 09:11:08,948 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:08,952 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 09:11:08,952 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:08,952 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-16 09:11:08,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:08,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498668955 (current time:1689498668955). 2023-07-16 09:11:08,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:08,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x3c8993a8 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:08,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bb092a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:08,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:08,968 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:08,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c8993a8 to 127.0.0.1:59352 2023-07-16 09:11:08,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:08,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x710638ff to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:08,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e2f1a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:08,977 DEBUG [hconnection-0xec87e87-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:08,978 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:08,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:08,983 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:08,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x710638ff to 127.0.0.1:59352 2023-07-16 09:11:08,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:08,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:11:08,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:08,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:08,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:08,989 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:08,990 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499268990 2023-07-16 09:11:08,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:08,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 09:11:08,991 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:08,991 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:08,993 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:08,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:08,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 09:11:08,995 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:08,996 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499268996 2023-07-16 09:11:09,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,014 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 09:11:09,015 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,016 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 09:11:09,016 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:11:09,016 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,016 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,018 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,018 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,018 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,018 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,019 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,019 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,019 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,019 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,021 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,021 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,021 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,022 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,022 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,022 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,022 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,022 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,029 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,029 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,029 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,029 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,029 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b517506[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:09,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b517506[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:09,036 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:11:09,036 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:11:09,040 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,040 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,040 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:09,041 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,041 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,041 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,043 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:09,043 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:09,043 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:09,043 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:09,044 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:09,043 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. started... 2023-07-16 09:11:09,043 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:09,044 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. started... 2023-07-16 09:11:09,045 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e771bea2f7367716c17721a7f579622a: 2023-07-16 09:11:09,046 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9435a716c06bd3a009727d6cfba855f6: 2023-07-16 09:11:09,046 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,046 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,046 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:09,046 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:09,047 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:09,047 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:09,082 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. completed. 2023-07-16 09:11:09,082 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:09,082 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,082 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,082 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,082 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,083 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:11:09,084 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,084 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,085 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,085 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,088 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. completed. 2023-07-16 09:11:09,088 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:11:09,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,090 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,090 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,090 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,090 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,092 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:09,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,093 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:09,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:11:09,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:11:09,106 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 09:11:09,106 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:09,107 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:09,107 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,107 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:09,109 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,109 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,109 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,109 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,109 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,110 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,110 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,110 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,115 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,123 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,128 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,130 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,133 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,138 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,138 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,139 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,139 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,141 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,141 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,141 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,142 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,142 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,142 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,142 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,225 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 09:11:09,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,226 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689498668990Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689498669139 (+149 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689498669142 (+3 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689498669147 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689498669177 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689498669225 (+48 ms) 2023-07-16 09:11:09,229 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 239 msec 2023-07-16 09:11:09,293 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:09,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:09,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34051] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 09:11:09,317 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:09,319 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:09,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:09,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498669334 (current time:1689498669334). 2023-07-16 09:11:09,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:09,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x3465bf6a to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:09,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78ab4e50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:09,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:09,350 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:09,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3465bf6a to 127.0.0.1:59352 2023-07-16 09:11:09,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:09,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x2395583f to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:09,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18e93d14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:09,369 DEBUG [hconnection-0x3466b001-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:09,372 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:09,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:09,379 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:09,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2395583f to 127.0.0.1:59352 2023-07-16 09:11:09,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:09,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:11:09,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:09,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:09,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:09,386 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:09,387 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499269387 2023-07-16 09:11:09,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:09,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 09:11:09,389 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:09,390 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:09,391 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:09,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-16 09:11:09,394 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,395 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499269395 2023-07-16 09:11:09,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 09:11:09,420 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 09:11:09,420 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,422 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 09:11:09,422 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:11:09,423 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,423 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,424 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,424 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,424 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,424 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,425 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,425 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,425 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,425 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:09,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,427 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,427 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,427 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,428 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,428 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,427 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,428 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,428 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,431 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,431 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,431 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,431 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,430 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,432 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,432 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,433 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,433 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,434 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,434 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,436 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,437 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,437 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50dc6b99[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:09,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50dc6b99[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:09,444 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:11:09,444 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,445 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,446 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:09,446 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,446 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. started... 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,446 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:11:09,446 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,446 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:09,446 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e771bea2f7367716c17721a7f579622a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 09:11:09,448 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,448 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,448 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,458 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:09,462 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:09,463 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. started... 2023-07-16 09:11:09,463 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9435a716c06bd3a009727d6cfba855f6 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 09:11:09,463 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:09,490 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:09,492 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:09,503 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/.tmp/cf/db631456120246b488bd684bcdba56fe 2023-07-16 09:11:09,514 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/.tmp/cf/081ca87aff5044988ce6dbb63b98a650 2023-07-16 09:11:09,523 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/.tmp/cf/db631456120246b488bd684bcdba56fe as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf/db631456120246b488bd684bcdba56fe 2023-07-16 09:11:09,527 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/.tmp/cf/081ca87aff5044988ce6dbb63b98a650 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf/081ca87aff5044988ce6dbb63b98a650 2023-07-16 09:11:09,531 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf/db631456120246b488bd684bcdba56fe, entries=46, sequenceid=6, filesize=7.9 K 2023-07-16 09:11:09,534 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e771bea2f7367716c17721a7f579622a in 88ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:09,534 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 09:11:09,535 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf/081ca87aff5044988ce6dbb63b98a650, entries=4, sequenceid=6, filesize=5.1 K 2023-07-16 09:11:09,537 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e771bea2f7367716c17721a7f579622a: 2023-07-16 09:11:09,537 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,537 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:09,537 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf/db631456120246b488bd684bcdba56fe] hfiles 2023-07-16 09:11:09,537 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf/db631456120246b488bd684bcdba56fe for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,538 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9435a716c06bd3a009727d6cfba855f6 in 75ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:09,539 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9435a716c06bd3a009727d6cfba855f6: 2023-07-16 09:11:09,539 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,539 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:09,539 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf/081ca87aff5044988ce6dbb63b98a650] hfiles 2023-07-16 09:11:09,539 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf/081ca87aff5044988ce6dbb63b98a650 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,566 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. completed. 2023-07-16 09:11:09,566 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:09,566 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,566 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,567 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,567 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,567 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:11:09,567 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. completed. 2023-07-16 09:11:09,567 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:09,567 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,567 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,568 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,568 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,568 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:11:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,573 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,575 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,575 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,575 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,577 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:11:09,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:11:09,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:11:09,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:11:09,585 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 09:11:09,585 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:09,585 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:09,585 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,585 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,587 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,588 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,588 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,590 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,591 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,591 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:09,594 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 09:11:09,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 09:11:09,595 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:09,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,597 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,648 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 09:11:09,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,649 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689498669388Consolidate snapshot: snaptb0-testExportFileSystemState at 1689498669595 (+207 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689498669595Writing data manifest for snaptb0-testExportFileSystemState at 1689498669600 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689498669609 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689498669648 (+39 ms) 2023-07-16 09:11:09,651 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 262 msec 2023-07-16 09:11:09,692 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:09,694 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694 2023-07-16 09:11:09,694 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33301, tgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694, rawTgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:11:09,718 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:11:09,718 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_405644668_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,718 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 09:11:09,731 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,764 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,764 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,765 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,765 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,765 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,766 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,766 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,838 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-1971617369553294697.jar 2023-07-16 09:11:09,839 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,839 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,840 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,840 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,840 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,840 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,841 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:11:09,841 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:11:09,842 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:11:09,842 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:11:09,842 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:11:09,843 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:11:09,843 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:11:09,843 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:11:09,844 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:11:09,844 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:11:09,845 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:09,845 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:09,845 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:09,846 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:09,846 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:09,846 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:09,847 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:10,800 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:11:10,802 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 09:11:10,804 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 09:11:12,139 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:12,142 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:12,148 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:12,939 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:13,627 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:11:17,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:20,076 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:23,020 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:24,071 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:24,072 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:24,079 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 09:11:24,079 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:24,080 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:24,080 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 09:11:24,080 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 09:11:24,081 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 09:11:24,081 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 09:11:24,081 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 09:11:24,081 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498669694/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 09:11:24,088 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 09:11:24,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 09:11:24,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 09:11:24,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498684094"}]},"ts":"1689498684094"} 2023-07-16 09:11:24,095 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 09:11:24,097 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 09:11:24,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, UNASSIGN}] 2023-07-16 09:11:24,100 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, UNASSIGN 2023-07-16 09:11:24,100 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, UNASSIGN 2023-07-16 09:11:24,101 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9435a716c06bd3a009727d6cfba855f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:24,101 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498684101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498684101"}]},"ts":"1689498684101"} 2023-07-16 09:11:24,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e771bea2f7367716c17721a7f579622a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:24,102 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498684101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498684101"}]},"ts":"1689498684101"} 2023-07-16 09:11:24,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9435a716c06bd3a009727d6cfba855f6, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:11:24,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure e771bea2f7367716c17721a7f579622a, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:11:24,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 09:11:24,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:24,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9435a716c06bd3a009727d6cfba855f6, disabling compactions & flushes 2023-07-16 09:11:24,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:24,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:24,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. after waiting 0 ms 2023-07-16 09:11:24,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:24,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:24,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e771bea2f7367716c17721a7f579622a, disabling compactions & flushes 2023-07-16 09:11:24,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:24,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:24,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. after waiting 0 ms 2023-07-16 09:11:24,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:24,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:24,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:24,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:24,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:24,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6. 2023-07-16 09:11:24,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9435a716c06bd3a009727d6cfba855f6: 2023-07-16 09:11:24,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a. 2023-07-16 09:11:24,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e771bea2f7367716c17721a7f579622a: 2023-07-16 09:11:24,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:24,287 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9435a716c06bd3a009727d6cfba855f6, regionState=CLOSED 2023-07-16 09:11:24,287 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684287"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684287"}]},"ts":"1689498684287"} 2023-07-16 09:11:24,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:24,292 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e771bea2f7367716c17721a7f579622a, regionState=CLOSED 2023-07-16 09:11:24,292 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684291"}]},"ts":"1689498684291"} 2023-07-16 09:11:24,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 09:11:24,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9435a716c06bd3a009727d6cfba855f6, server=jenkins-hbase4.apache.org,36871,1689498639173 in 187 msec 2023-07-16 09:11:24,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9435a716c06bd3a009727d6cfba855f6, UNASSIGN in 195 msec 2023-07-16 09:11:24,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 09:11:24,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure e771bea2f7367716c17721a7f579622a, server=jenkins-hbase4.apache.org,34051,1689498639118 in 189 msec 2023-07-16 09:11:24,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-16 09:11:24,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e771bea2f7367716c17721a7f579622a, UNASSIGN in 198 msec 2023-07-16 09:11:24,299 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498684299"}]},"ts":"1689498684299"} 2023-07-16 09:11:24,301 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 09:11:24,303 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 09:11:24,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 216 msec 2023-07-16 09:11:24,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 09:11:24,396 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 09:11:24,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 09:11:24,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,400 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 09:11:24,401 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,403 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 09:11:24,405 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,405 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,405 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,405 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,406 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:24,406 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:24,407 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,407 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,407 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,407 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,407 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,407 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,409 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/recovered.edits] 2023-07-16 09:11:24,409 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/recovered.edits] 2023-07-16 09:11:24,409 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,409 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 09:11:24,414 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf/081ca87aff5044988ce6dbb63b98a650 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/cf/081ca87aff5044988ce6dbb63b98a650 2023-07-16 09:11:24,414 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf/db631456120246b488bd684bcdba56fe to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/cf/db631456120246b488bd684bcdba56fe 2023-07-16 09:11:24,417 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6/recovered.edits/9.seqid 2023-07-16 09:11:24,418 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a/recovered.edits/9.seqid 2023-07-16 09:11:24,418 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/9435a716c06bd3a009727d6cfba855f6 2023-07-16 09:11:24,418 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemState/e771bea2f7367716c17721a7f579622a 2023-07-16 09:11:24,418 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 09:11:24,421 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,424 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 09:11:24,426 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 09:11:24,428 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,428 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 09:11:24,428 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498684428"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:24,428 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498684428"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:24,430 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:11:24,430 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9435a716c06bd3a009727d6cfba855f6, NAME => 'testtb-testExportFileSystemState,,1689498668336.9435a716c06bd3a009727d6cfba855f6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e771bea2f7367716c17721a7f579622a, NAME => 'testtb-testExportFileSystemState,1,1689498668336.e771bea2f7367716c17721a7f579622a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:11:24,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 09:11:24,430 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498684430"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:24,431 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 09:11:24,436 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 39 msec 2023-07-16 09:11:24,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 09:11:24,512 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 09:11:24,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 09:11:24,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:24,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 09:11:24,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 09:11:24,571 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=770 (was 759) Potentially hanging thread: Thread-2067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_342819211_1 at /127.0.0.1:35192 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:38146 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:55230 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:35220 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:35143 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_342819211_1 at /127.0.0.1:38132 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=501 (was 453) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2745 (was 2800) 2023-07-16 09:11:24,571 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-16 09:11:24,598 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=501, ProcessCount=181, AvailableMemoryMB=2745 2023-07-16 09:11:24,598 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-16 09:11:24,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:11:24,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:24,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:11:24,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 09:11:24,605 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:11:24,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:24,609 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:24,609 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:24,610 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 empty. 2023-07-16 09:11:24,610 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc empty. 2023-07-16 09:11:24,610 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:24,610 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:24,610 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 09:11:24,649 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 09:11:24,664 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7269b912c2536f1df003a1f6b4b062cc, NAME => 'testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:11:24,664 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d225cd90f3cadeb3c6291ccff6296653, NAME => 'testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:11:24,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:24,737 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:24,738 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 7269b912c2536f1df003a1f6b4b062cc, disabling compactions & flushes 2023-07-16 09:11:24,738 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:24,738 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:24,738 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. after waiting 0 ms 2023-07-16 09:11:24,738 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:24,738 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:24,738 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 7269b912c2536f1df003a1f6b4b062cc: 2023-07-16 09:11:24,744 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:24,744 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d225cd90f3cadeb3c6291ccff6296653, disabling compactions & flushes 2023-07-16 09:11:24,744 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:24,744 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:24,744 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. after waiting 0 ms 2023-07-16 09:11:24,744 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:24,744 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:24,744 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d225cd90f3cadeb3c6291ccff6296653: 2023-07-16 09:11:24,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:11:24,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498684748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684748"}]},"ts":"1689498684748"} 2023-07-16 09:11:24,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498684748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684748"}]},"ts":"1689498684748"} 2023-07-16 09:11:24,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:11:24,754 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:11:24,754 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498684754"}]},"ts":"1689498684754"} 2023-07-16 09:11:24,756 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 09:11:24,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:11:24,762 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:11:24,762 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:11:24,762 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:11:24,762 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:11:24,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, ASSIGN}] 2023-07-16 09:11:24,769 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, ASSIGN 2023-07-16 09:11:24,769 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, ASSIGN 2023-07-16 09:11:24,770 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46593,1689498639060; forceNewPlan=false, retain=false 2023-07-16 09:11:24,771 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:11:24,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:24,920 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:11:24,923 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7269b912c2536f1df003a1f6b4b062cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:24,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d225cd90f3cadeb3c6291ccff6296653, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:24,923 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498684923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498684923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498684923"}]},"ts":"1689498684923"} 2023-07-16 09:11:24,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498684923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498684923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498684923"}]},"ts":"1689498684923"} 2023-07-16 09:11:24,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 7269b912c2536f1df003a1f6b4b062cc, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:11:24,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure d225cd90f3cadeb3c6291ccff6296653, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:11:25,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7269b912c2536f1df003a1f6b4b062cc, NAME => 'testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:11:25,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d225cd90f3cadeb3c6291ccff6296653, NAME => 'testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. service=AccessControlService 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. service=AccessControlService 2023-07-16 09:11:25,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,087 INFO [StoreOpener-7269b912c2536f1df003a1f6b4b062cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,087 INFO [StoreOpener-d225cd90f3cadeb3c6291ccff6296653-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,088 DEBUG [StoreOpener-7269b912c2536f1df003a1f6b4b062cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf 2023-07-16 09:11:25,088 DEBUG [StoreOpener-7269b912c2536f1df003a1f6b4b062cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf 2023-07-16 09:11:25,088 DEBUG [StoreOpener-d225cd90f3cadeb3c6291ccff6296653-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf 2023-07-16 09:11:25,088 DEBUG [StoreOpener-d225cd90f3cadeb3c6291ccff6296653-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf 2023-07-16 09:11:25,088 INFO [StoreOpener-7269b912c2536f1df003a1f6b4b062cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7269b912c2536f1df003a1f6b4b062cc columnFamilyName cf 2023-07-16 09:11:25,088 INFO [StoreOpener-d225cd90f3cadeb3c6291ccff6296653-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d225cd90f3cadeb3c6291ccff6296653 columnFamilyName cf 2023-07-16 09:11:25,089 INFO [StoreOpener-7269b912c2536f1df003a1f6b4b062cc-1] regionserver.HStore(310): Store=7269b912c2536f1df003a1f6b4b062cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:25,089 INFO [StoreOpener-d225cd90f3cadeb3c6291ccff6296653-1] regionserver.HStore(310): Store=d225cd90f3cadeb3c6291ccff6296653/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:25,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:25,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:25,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:25,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:25,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7269b912c2536f1df003a1f6b4b062cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64564415, jitterRate=-0.037915244698524475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:25,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d225cd90f3cadeb3c6291ccff6296653; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67169241, jitterRate=8.996874094009399E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:25,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7269b912c2536f1df003a1f6b4b062cc: 2023-07-16 09:11:25,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d225cd90f3cadeb3c6291ccff6296653: 2023-07-16 09:11:25,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc., pid=45, masterSystemTime=1689498685077 2023-07-16 09:11:25,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653., pid=46, masterSystemTime=1689498685078 2023-07-16 09:11:25,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,099 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7269b912c2536f1df003a1f6b4b062cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,099 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498685099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498685099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498685099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498685099"}]},"ts":"1689498685099"} 2023-07-16 09:11:25,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d225cd90f3cadeb3c6291ccff6296653, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498685100"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498685100"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498685100"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498685100"}]},"ts":"1689498685100"} 2023-07-16 09:11:25,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-16 09:11:25,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 7269b912c2536f1df003a1f6b4b062cc, server=jenkins-hbase4.apache.org,46593,1689498639060 in 176 msec 2023-07-16 09:11:25,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-16 09:11:25,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure d225cd90f3cadeb3c6291ccff6296653, server=jenkins-hbase4.apache.org,34051,1689498639118 in 176 msec 2023-07-16 09:11:25,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, ASSIGN in 340 msec 2023-07-16 09:11:25,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-16 09:11:25,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, ASSIGN in 341 msec 2023-07-16 09:11:25,107 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:11:25,107 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498685107"}]},"ts":"1689498685107"} 2023-07-16 09:11:25,108 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 09:11:25,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:11:25,111 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 09:11:25,113 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 09:11:25,116 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,116 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,116 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,116 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 517 msec 2023-07-16 09:11:25,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:25,210 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 09:11:25,210 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-16 09:11:25,211 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:25,214 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-16 09:11:25,215 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:25,215 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-16 09:11:25,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498685220 (current time:1689498685220). 2023-07-16 09:11:25,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:25,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x169e14bc to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@caa6534, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,236 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x169e14bc to 127.0.0.1:59352 2023-07-16 09:11:25,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x1bc069b4 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d1da584, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,249 DEBUG [hconnection-0x22c1fcd6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,253 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,260 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bc069b4 to 127.0.0.1:59352 2023-07-16 09:11:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 09:11:25,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:25,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,266 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,267 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689499285266 2023-07-16 09:11:25,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 09:11:25,268 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:25,268 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:25,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,272 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-16 09:11:25,274 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,275 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689499285275 2023-07-16 09:11:25,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,285 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 09:11:25,285 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,286 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 09:11:25,286 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 09:11:25,287 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,287 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,288 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,288 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,288 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,288 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,289 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,289 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,289 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,289 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 09:11:25,290 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 09:11:25,290 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,291 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,291 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,291 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,293 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,293 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,293 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,293 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,293 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,296 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,296 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,296 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,297 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,300 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,300 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,300 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,300 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,300 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,301 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,301 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@152954b5[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@152954b5[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:25,306 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 09:11:25,306 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,307 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,308 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,308 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,308 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,308 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. started... 2023-07-16 09:11:25,308 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:25,308 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,308 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. started... 2023-07-16 09:11:25,311 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7269b912c2536f1df003a1f6b4b062cc: 2023-07-16 09:11:25,311 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d225cd90f3cadeb3c6291ccff6296653: 2023-07-16 09:11:25,311 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,311 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,312 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,313 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,313 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:25,313 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:25,317 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,317 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,317 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,334 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. completed. 2023-07-16 09:11:25,334 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,335 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,335 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:11:25,336 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,336 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,336 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,337 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,339 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. completed. 2023-07-16 09:11:25,339 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,339 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:25,339 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,341 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,341 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,342 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:11:25,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 09:11:25,349 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 09:11:25,349 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:25,349 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:25,349 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,349 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,355 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,355 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,356 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,357 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,359 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,359 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,359 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,363 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,363 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,365 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,363 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,365 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,365 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,365 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,365 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,368 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:25,370 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:25,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 09:11:25,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,415 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689498685267Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689498685365 (+98 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689498685365Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689498685370 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689498685383 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689498685415 (+32 ms) 2023-07-16 09:11:25,418 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 150 msec 2023-07-16 09:11:25,570 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:25,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34051] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:25,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46593] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:25,596 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 09:11:25,597 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,598 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:25,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498685616 (current time:1689498685616). 2023-07-16 09:11:25,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:25,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x0a5afe75 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a421298, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,637 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a5afe75 to 127.0.0.1:59352 2023-07-16 09:11:25,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x242fbb3b to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@795b509d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,662 DEBUG [hconnection-0x33c75bfc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,664 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,670 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x242fbb3b to 127.0.0.1:59352 2023-07-16 09:11:25,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 09:11:25,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,676 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,677 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689499285677 2023-07-16 09:11:25,677 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 09:11:25,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,678 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:25,679 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:25,680 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-16 09:11:25,682 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,683 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689499285683 2023-07-16 09:11:25,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 09:11:25,694 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 09:11:25,694 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,695 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 09:11:25,695 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 09:11:25,696 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,696 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,697 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,697 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,697 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,698 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,698 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,698 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,698 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,698 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,702 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,702 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,702 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,703 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,704 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,704 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,702 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,705 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,705 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,705 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,706 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,706 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,708 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,708 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,708 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,708 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20530cff[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20530cff[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:25,714 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 09:11:25,714 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,715 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,715 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,715 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,716 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,716 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,716 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. started... 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,716 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d225cd90f3cadeb3c6291ccff6296653 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:11:25,716 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,716 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,716 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,717 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,716 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. started... 2023-07-16 09:11:25,717 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7269b912c2536f1df003a1f6b4b062cc 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 09:11:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,738 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/.tmp/cf/e86c86fa77154121bae993671e20ac9b 2023-07-16 09:11:25,741 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/.tmp/cf/054c5c8c30d745cea9405b95e53e1546 2023-07-16 09:11:25,750 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/.tmp/cf/e86c86fa77154121bae993671e20ac9b as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf/e86c86fa77154121bae993671e20ac9b 2023-07-16 09:11:25,751 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/.tmp/cf/054c5c8c30d745cea9405b95e53e1546 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf/054c5c8c30d745cea9405b95e53e1546 2023-07-16 09:11:25,756 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf/e86c86fa77154121bae993671e20ac9b, entries=5, sequenceid=6, filesize=5.2 K 2023-07-16 09:11:25,757 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d225cd90f3cadeb3c6291ccff6296653 in 41ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:25,758 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 09:11:25,758 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf/054c5c8c30d745cea9405b95e53e1546, entries=45, sequenceid=6, filesize=7.9 K 2023-07-16 09:11:25,759 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d225cd90f3cadeb3c6291ccff6296653: 2023-07-16 09:11:25,759 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 7269b912c2536f1df003a1f6b4b062cc in 42ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7269b912c2536f1df003a1f6b4b062cc: 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf/e86c86fa77154121bae993671e20ac9b] hfiles 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf/e86c86fa77154121bae993671e20ac9b for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,760 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf/054c5c8c30d745cea9405b95e53e1546] hfiles 2023-07-16 09:11:25,761 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf/054c5c8c30d745cea9405b95e53e1546 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,778 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. completed. 2023-07-16 09:11:25,778 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:25,778 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. completed. 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,778 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,778 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:11:25,779 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:25,780 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,781 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,783 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,781 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,784 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:11:25,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 09:11:25,792 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 09:11:25,792 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:25,792 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:25,792 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,792 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,795 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,796 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,796 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,799 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,800 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,800 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,808 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,808 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,808 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,808 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,808 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,809 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,809 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,808 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 09:11:25,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,811 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:25,812 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:25,812 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,812 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 09:11:25,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,868 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689498685677Consolidate snapshot: snaptb0-testConsecutiveExports at 1689498685811 (+134 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689498685811Writing data manifest for snaptb0-testConsecutiveExports at 1689498685822 (+11 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689498685835 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689498685868 (+33 ms) 2023-07-16 09:11:25,871 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 193 msec 2023-07-16 09:11:25,980 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:25,982 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982 2023-07-16 09:11:25,982 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:11:26,008 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:11:26,008 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6f856117, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,008 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 09:11:26,022 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,037 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,037 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,037 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,038 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,038 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,038 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,039 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,123 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-6471943204840267477.jar 2023-07-16 09:11:26,124 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,124 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,125 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,125 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,125 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,126 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,126 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:11:26,127 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:11:26,127 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:11:26,128 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:11:26,128 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:11:26,129 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:11:26,129 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:11:26,129 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:11:26,130 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:11:26,130 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:11:26,131 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,131 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,132 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:26,132 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,133 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,133 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:26,134 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:26,957 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:11:26,959 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 09:11:26,961 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 09:11:29,206 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:29,206 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:29,211 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:29,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:11:30,152 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:34,789 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:37,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:39,770 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:41,169 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:41,169 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:41,174 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 09:11:41,174 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:41,175 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:41,175 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:41,177 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:41,178 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:41,178 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58c0b3ad in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:41,178 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:41,178 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:41,180 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:11:41,207 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:11:41,207 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@da3c545, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:41,207 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 09:11:41,218 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:41,231 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,231 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,232 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,232 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,233 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,233 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,233 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,320 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-245460102761682592.jar 2023-07-16 09:11:41,321 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:11:41,324 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:11:41,324 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:11:41,325 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:11:41,325 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:11:41,325 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:11:41,326 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:11:41,326 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:11:41,326 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:11:41,327 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:11:41,327 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,328 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,328 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:41,328 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,329 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,329 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:41,329 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:41,802 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:11:41,804 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 09:11:41,806 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 09:11:45,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:45,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:45,948 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:46,225 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:50,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:52,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:56,396 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:58,013 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:58,013 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:58,016 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 09:11:58,016 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:58,016 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:58,016 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:58,019 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:58,019 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:58,019 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58c0b3ad in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:58,020 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:58,020 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/local-export-1689498685982/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:58,037 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 09:11:58,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 09:11:58,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 09:11:58,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498718045"}]},"ts":"1689498718045"} 2023-07-16 09:11:58,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 09:11:58,048 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 09:11:58,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, UNASSIGN}] 2023-07-16 09:11:58,052 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, UNASSIGN 2023-07-16 09:11:58,052 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, UNASSIGN 2023-07-16 09:11:58,053 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d225cd90f3cadeb3c6291ccff6296653, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:58,053 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7269b912c2536f1df003a1f6b4b062cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:58,053 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498718053"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498718053"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498718053"}]},"ts":"1689498718053"} 2023-07-16 09:11:58,053 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498718053"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498718053"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498718053"}]},"ts":"1689498718053"} 2023-07-16 09:11:58,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 7269b912c2536f1df003a1f6b4b062cc, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:11:58,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure d225cd90f3cadeb3c6291ccff6296653, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:11:58,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 09:11:58,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:58,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7269b912c2536f1df003a1f6b4b062cc, disabling compactions & flushes 2023-07-16 09:11:58,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:58,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:58,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. after waiting 0 ms 2023-07-16 09:11:58,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:58,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:58,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d225cd90f3cadeb3c6291ccff6296653, disabling compactions & flushes 2023-07-16 09:11:58,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:58,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:58,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. after waiting 0 ms 2023-07-16 09:11:58,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:58,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:58,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:58,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc. 2023-07-16 09:11:58,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7269b912c2536f1df003a1f6b4b062cc: 2023-07-16 09:11:58,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:58,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:58,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653. 2023-07-16 09:11:58,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d225cd90f3cadeb3c6291ccff6296653: 2023-07-16 09:11:58,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:58,228 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7269b912c2536f1df003a1f6b4b062cc, regionState=CLOSED 2023-07-16 09:11:58,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:58,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498718228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718228"}]},"ts":"1689498718228"} 2023-07-16 09:11:58,229 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d225cd90f3cadeb3c6291ccff6296653, regionState=CLOSED 2023-07-16 09:11:58,230 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498718229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718229"}]},"ts":"1689498718229"} 2023-07-16 09:11:58,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-16 09:11:58,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 7269b912c2536f1df003a1f6b4b062cc, server=jenkins-hbase4.apache.org,46593,1689498639060 in 175 msec 2023-07-16 09:11:58,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-16 09:11:58,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure d225cd90f3cadeb3c6291ccff6296653, server=jenkins-hbase4.apache.org,34051,1689498639118 in 174 msec 2023-07-16 09:11:58,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7269b912c2536f1df003a1f6b4b062cc, UNASSIGN in 183 msec 2023-07-16 09:11:58,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-16 09:11:58,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d225cd90f3cadeb3c6291ccff6296653, UNASSIGN in 185 msec 2023-07-16 09:11:58,236 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498718236"}]},"ts":"1689498718236"} 2023-07-16 09:11:58,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 09:11:58,239 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 09:11:58,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 201 msec 2023-07-16 09:11:58,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 09:11:58,348 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 09:11:58,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 09:11:58,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,353 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 09:11:58,354 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,356 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 09:11:58,360 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,360 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,360 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,360 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,362 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 09:11:58,364 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:58,367 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:58,369 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/recovered.edits] 2023-07-16 09:11:58,371 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/recovered.edits] 2023-07-16 09:11:58,381 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf/e86c86fa77154121bae993671e20ac9b to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/cf/e86c86fa77154121bae993671e20ac9b 2023-07-16 09:11:58,382 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf/054c5c8c30d745cea9405b95e53e1546 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/cf/054c5c8c30d745cea9405b95e53e1546 2023-07-16 09:11:58,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc/recovered.edits/9.seqid 2023-07-16 09:11:58,387 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653/recovered.edits/9.seqid 2023-07-16 09:11:58,388 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/d225cd90f3cadeb3c6291ccff6296653 2023-07-16 09:11:58,388 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testConsecutiveExports/7269b912c2536f1df003a1f6b4b062cc 2023-07-16 09:11:58,388 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 09:11:58,391 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,393 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 09:11:58,395 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 09:11:58,396 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,397 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 09:11:58,397 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498718397"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:58,397 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498718397"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:58,399 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:11:58,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d225cd90f3cadeb3c6291ccff6296653, NAME => 'testtb-testConsecutiveExports,,1689498684600.d225cd90f3cadeb3c6291ccff6296653.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7269b912c2536f1df003a1f6b4b062cc, NAME => 'testtb-testConsecutiveExports,1,1689498684600.7269b912c2536f1df003a1f6b4b062cc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:11:58,399 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 09:11:58,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498718399"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:58,401 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 09:11:58,403 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 54 msec 2023-07-16 09:11:58,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 09:11:58,464 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 09:11:58,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 09:11:58,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:58,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 09:11:58,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 09:11:58,516 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=751 (was 770), OpenFileDescriptor=914 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=512 (was 501) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3341 (was 2745) - AvailableMemoryMB LEAK? - 2023-07-16 09:11:58,517 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 09:11:58,542 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=512, ProcessCount=183, AvailableMemoryMB=3334 2023-07-16 09:11:58,542 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 09:11:58,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:11:58,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:58,548 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:11:58,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 09:11:58,549 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:11:58,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,551 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,551 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,552 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 empty. 2023-07-16 09:11:58,552 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 empty. 2023-07-16 09:11:58,553 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,553 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,553 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 09:11:58,570 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 09:11:58,572 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 558c0246ac3a6220592cf40077df0391, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:11:58,572 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a26b781b228f29f73b2ab2d7af475504, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a26b781b228f29f73b2ab2d7af475504, disabling compactions & flushes 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 558c0246ac3a6220592cf40077df0391, disabling compactions & flushes 2023-07-16 09:11:58,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:58,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. after waiting 0 ms 2023-07-16 09:11:58,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. after waiting 0 ms 2023-07-16 09:11:58,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:58,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:58,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a26b781b228f29f73b2ab2d7af475504: 2023-07-16 09:11:58,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 558c0246ac3a6220592cf40077df0391: 2023-07-16 09:11:58,597 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:11:58,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718598"}]},"ts":"1689498718598"} 2023-07-16 09:11:58,599 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718598"}]},"ts":"1689498718598"} 2023-07-16 09:11:58,609 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:11:58,610 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:11:58,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498718610"}]},"ts":"1689498718610"} 2023-07-16 09:11:58,611 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 09:11:58,615 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:11:58,616 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:11:58,616 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:11:58,616 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:11:58,616 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:11:58,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, ASSIGN}] 2023-07-16 09:11:58,620 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, ASSIGN 2023-07-16 09:11:58,620 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, ASSIGN 2023-07-16 09:11:58,621 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36871,1689498639173; forceNewPlan=false, retain=false 2023-07-16 09:11:58,621 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46593,1689498639060; forceNewPlan=false, retain=false 2023-07-16 09:11:58,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,771 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:11:58,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a26b781b228f29f73b2ab2d7af475504, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:58,775 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=558c0246ac3a6220592cf40077df0391, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:58,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498718775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498718775"}]},"ts":"1689498718775"} 2023-07-16 09:11:58,775 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498718775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498718775"}]},"ts":"1689498718775"} 2023-07-16 09:11:58,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 558c0246ac3a6220592cf40077df0391, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:11:58,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure a26b781b228f29f73b2ab2d7af475504, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:11:58,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 558c0246ac3a6220592cf40077df0391, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:11:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. service=AccessControlService 2023-07-16 09:11:58,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,938 INFO [StoreOpener-558c0246ac3a6220592cf40077df0391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,940 DEBUG [StoreOpener-558c0246ac3a6220592cf40077df0391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf 2023-07-16 09:11:58,941 DEBUG [StoreOpener-558c0246ac3a6220592cf40077df0391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf 2023-07-16 09:11:58,942 INFO [StoreOpener-558c0246ac3a6220592cf40077df0391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 558c0246ac3a6220592cf40077df0391 columnFamilyName cf 2023-07-16 09:11:58,949 INFO [StoreOpener-558c0246ac3a6220592cf40077df0391-1] regionserver.HStore(310): Store=558c0246ac3a6220592cf40077df0391/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:58,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:58,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a26b781b228f29f73b2ab2d7af475504, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:11:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. service=AccessControlService 2023-07-16 09:11:58,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,958 INFO [StoreOpener-a26b781b228f29f73b2ab2d7af475504-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,960 DEBUG [StoreOpener-a26b781b228f29f73b2ab2d7af475504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf 2023-07-16 09:11:58,960 DEBUG [StoreOpener-a26b781b228f29f73b2ab2d7af475504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf 2023-07-16 09:11:58,960 INFO [StoreOpener-a26b781b228f29f73b2ab2d7af475504-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a26b781b228f29f73b2ab2d7af475504 columnFamilyName cf 2023-07-16 09:11:58,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 558c0246ac3a6220592cf40077df0391 2023-07-16 09:11:58,961 INFO [StoreOpener-a26b781b228f29f73b2ab2d7af475504-1] regionserver.HStore(310): Store=a26b781b228f29f73b2ab2d7af475504/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:58,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:58,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 558c0246ac3a6220592cf40077df0391; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59162500, jitterRate=-0.11841005086898804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:58,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 558c0246ac3a6220592cf40077df0391: 2023-07-16 09:11:58,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391., pid=60, masterSystemTime=1689498718931 2023-07-16 09:11:58,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:11:58,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:58,970 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=558c0246ac3a6220592cf40077df0391, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:58,970 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498718970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498718970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498718970"}]},"ts":"1689498718970"} 2023-07-16 09:11:58,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-16 09:11:58,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 558c0246ac3a6220592cf40077df0391, server=jenkins-hbase4.apache.org,46593,1689498639060 in 206 msec 2023-07-16 09:11:58,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, ASSIGN in 376 msec 2023-07-16 09:11:58,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:59,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a26b781b228f29f73b2ab2d7af475504; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63064264, jitterRate=-0.06026923656463623}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:59,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a26b781b228f29f73b2ab2d7af475504: 2023-07-16 09:11:59,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504., pid=61, masterSystemTime=1689498718942 2023-07-16 09:11:59,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:59,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:59,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a26b781b228f29f73b2ab2d7af475504, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498719004"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498719004"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498719004"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498719004"}]},"ts":"1689498719004"} 2023-07-16 09:11:59,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-16 09:11:59,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure a26b781b228f29f73b2ab2d7af475504, server=jenkins-hbase4.apache.org,36871,1689498639173 in 220 msec 2023-07-16 09:11:59,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-16 09:11:59,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, ASSIGN in 391 msec 2023-07-16 09:11:59,012 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:11:59,012 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498719012"}]},"ts":"1689498719012"} 2023-07-16 09:11:59,015 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 09:11:59,018 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:11:59,018 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 09:11:59,020 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 09:11:59,023 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:59,023 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:59,023 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:59,023 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:59,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:59,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:59,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:59,026 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:59,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 481 msec 2023-07-16 09:11:59,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:59,154 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 09:11:59,154 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-16 09:11:59,154 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:59,158 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-16 09:11:59,159 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:59,159 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-16 09:11:59,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498719163 (current time:1689498719163). 2023-07-16 09:11:59,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:59,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x5acb5195 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:59,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43e33e5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:59,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,202 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5acb5195 to 127.0.0.1:59352 2023-07-16 09:11:59,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:59,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x7d136e84 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:59,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd4df4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:59,229 DEBUG [hconnection-0x271f077b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,234 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,245 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d136e84 to 127.0.0.1:59352 2023-07-16 09:11:59,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:59,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 09:11:59,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:59,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,251 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,252 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689499319252 2023-07-16 09:11:59,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,253 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:59,253 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:59,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,255 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-16 09:11:59,257 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,258 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689499319258 2023-07-16 09:11:59,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,269 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 09:11:59,269 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,271 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 09:11:59,271 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 09:11:59,351 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,351 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,353 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,353 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,353 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,353 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,354 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:11:59,355 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 09:11:59,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,355 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:59,355 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:11:59,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,355 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 09:11:59,356 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:11:59,356 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 09:11:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,357 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:11:59,358 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:11:59,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:11:59,358 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:11:59,358 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,358 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:59,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,358 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:11:59,359 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,359 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:11:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:11:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:11:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:11:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,360 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,361 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,361 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:59,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,363 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:11:59,363 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,364 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:11:59,364 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:11:59,364 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:11:59,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,367 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,367 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:11:59,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30bab4b6[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:59,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,368 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,368 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:59,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:11:59,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30bab4b6[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:59,373 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 09:11:59,373 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:11:59,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,374 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:11:59,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:59,375 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:59,375 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:59,375 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:59,375 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:59,375 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:59,375 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. started... 2023-07-16 09:11:59,375 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. started... 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 558c0246ac3a6220592cf40077df0391: 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a26b781b228f29f73b2ab2d7af475504: 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:59,377 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:59,379 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:11:59,379 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,380 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:11:59,400 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. completed. 2023-07-16 09:11:59,401 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:59,401 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:59,401 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:59,401 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,401 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:11:59,401 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:11:59,404 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:11:59,404 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,404 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,404 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:11:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,410 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. completed. 2023-07-16 09:11:59,411 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:11:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:11:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:11:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:11:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:11:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,417 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:11:59,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 09:11:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:11:59,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 09:11:59,423 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 09:11:59,423 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:59,423 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:59,423 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,423 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,425 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,426 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,427 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,428 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,431 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,431 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,432 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,436 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,436 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,436 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,436 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,435 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,436 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,436 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:11:59,437 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,437 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:11:59,437 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:11:59,437 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,437 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,555 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:59,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:11:59,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:59,557 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:11:59,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 09:11:59,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,566 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689498719252Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719436 (+184 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719437 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719449 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719487 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689498719565 (+78 ms) 2023-07-16 09:11:59,570 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 317 msec 2023-07-16 09:11:59,857 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:59,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:11:59,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:59,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46593] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:59,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:59,881 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,881 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:11:59,881 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:59,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498719898 (current time:1689498719898). 2023-07-16 09:11:59,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:59,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x2d137a2a to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:59,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f8d0ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:59,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,928 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d137a2a to 127.0.0.1:59352 2023-07-16 09:11:59,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:59,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x745c8e1d to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:59,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42a86896, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:59,953 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 09:11:59,953 DEBUG [hconnection-0x6933714-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,960 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,972 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x745c8e1d to 127.0.0.1:59352 2023-07-16 09:11:59,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:59,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 09:11:59,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:59,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,979 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,980 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689499319980 2023-07-16 09:11:59,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,982 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:59,983 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:59,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,984 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-16 09:11:59,987 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,988 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689499319988 2023-07-16 09:12:00,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,010 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 09:12:00,010 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,012 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 09:12:00,012 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 09:12:00,013 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,013 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,015 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,015 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,015 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,019 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,019 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,020 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,020 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:12:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 09:12:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:12:00,020 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:00,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,024 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:12:00,024 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,027 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:12:00,027 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,032 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:12:00,032 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:12:00,032 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:12:00,033 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:12:00,032 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,032 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:12:00,033 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:12:00,033 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:12:00,034 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:12:00,034 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:12:00,034 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:12:00,037 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,037 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,037 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,037 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,037 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,037 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,038 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:00,038 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,038 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,038 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,038 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:12:00,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@309919b[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:12:00,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@309919b[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:00,044 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 09:12:00,045 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:12:00,046 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,047 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:12:00,047 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:12:00,047 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,047 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:12:00,047 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:12:00,047 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,047 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:00,049 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:12:00,049 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,049 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:12:00,050 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:00,067 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:12:00,067 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:00,066 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:00,067 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:00,067 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. started... 2023-07-16 09:12:00,067 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 558c0246ac3a6220592cf40077df0391 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 09:12:00,070 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:12:00,070 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. started... 2023-07-16 09:12:00,070 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a26b781b228f29f73b2ab2d7af475504 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 09:12:00,083 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:00,084 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:00,115 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/.tmp/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae 2023-07-16 09:12:00,117 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/.tmp/cf/ac9694f2a57b443785f046f97ae629f5 2023-07-16 09:12:00,127 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/.tmp/cf/ac9694f2a57b443785f046f97ae629f5 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf/ac9694f2a57b443785f046f97ae629f5 2023-07-16 09:12:00,129 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/.tmp/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae 2023-07-16 09:12:00,135 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae, entries=48, sequenceid=6, filesize=8.1 K 2023-07-16 09:12:00,139 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for a26b781b228f29f73b2ab2d7af475504 in 68ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:00,140 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a26b781b228f29f73b2ab2d7af475504: 2023-07-16 09:12:00,140 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,140 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:00,140 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae] hfiles 2023-07-16 09:12:00,140 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,147 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf/ac9694f2a57b443785f046f97ae629f5, entries=2, sequenceid=6, filesize=5.0 K 2023-07-16 09:12:00,148 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 558c0246ac3a6220592cf40077df0391 in 81ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:00,148 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 558c0246ac3a6220592cf40077df0391: 2023-07-16 09:12:00,148 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,148 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:00,149 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf/ac9694f2a57b443785f046f97ae629f5] hfiles 2023-07-16 09:12:00,149 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf/ac9694f2a57b443785f046f97ae629f5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,255 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. completed. 2023-07-16 09:12:00,255 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:12:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:12:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:12:00,259 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:12:00,259 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,259 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,259 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:12:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:12:00,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 09:12:00,284 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:00,287 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:00,300 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. completed. 2023-07-16 09:12:00,300 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:12:00,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:00,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:00,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:12:00,300 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:12:00,302 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,303 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:12:00,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,303 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,303 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:12:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:12:00,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 09:12:00,311 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 09:12:00,312 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:00,312 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:00,312 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,312 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:00,319 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,319 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,319 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,320 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,320 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,319 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,319 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,321 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,321 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,333 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,336 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,336 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,336 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,341 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:00,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,349 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,349 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:00,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:00,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,587 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:00,589 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:12:00,884 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 09:12:00,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,885 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689498719980Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689498720350 (+370 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689498720350Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689498720375 (+25 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689498720417 (+42 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689498720884 (+467 ms) 2023-07-16 09:12:00,888 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:12:00,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 906 msec 2023-07-16 09:12:01,089 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:01,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:01,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:01,123 DEBUG [Listener at jenkins-hbase4.apache.org/46737] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:12:01,128 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:12:01,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34051] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 09:12:01,130 DEBUG [Listener at jenkins-hbase4.apache.org/46737] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:12:01,134 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:12:01,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 09:12:01,134 DEBUG [Listener at jenkins-hbase4.apache.org/46737] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:12:01,140 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:12:01,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46593] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 09:12:01,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:12:01,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:01,160 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:12:01,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 09:12:01,161 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:12:01,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:01,171 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,171 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 empty. 2023-07-16 09:12:01,172 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,182 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,182 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 empty. 2023-07-16 09:12:01,183 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,183 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 09:12:01,199 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 09:12:01,200 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a4138d8110b1da3cb882f1fb6d5ca75, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:12:01,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7b5eb6b0a094c7d42172c45a1a1d2178, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:12:01,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:01,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 0a4138d8110b1da3cb882f1fb6d5ca75, disabling compactions & flushes 2023-07-16 09:12:01,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. after waiting 0 ms 2023-07-16 09:12:01,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 0a4138d8110b1da3cb882f1fb6d5ca75: 2023-07-16 09:12:01,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:01,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 7b5eb6b0a094c7d42172c45a1a1d2178, disabling compactions & flushes 2023-07-16 09:12:01,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. after waiting 0 ms 2023-07-16 09:12:01,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,230 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 7b5eb6b0a094c7d42172c45a1a1d2178: 2023-07-16 09:12:01,232 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:12:01,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498721233"}]},"ts":"1689498721233"} 2023-07-16 09:12:01,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498721233"}]},"ts":"1689498721233"} 2023-07-16 09:12:01,236 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:12:01,237 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:12:01,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498721237"}]},"ts":"1689498721237"} 2023-07-16 09:12:01,242 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 09:12:01,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:12:01,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:12:01,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:12:01,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:12:01,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:12:01,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, ASSIGN}] 2023-07-16 09:12:01,255 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, ASSIGN 2023-07-16 09:12:01,255 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, ASSIGN 2023-07-16 09:12:01,256 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46593,1689498639060; forceNewPlan=false, retain=false 2023-07-16 09:12:01,256 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:12:01,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:01,407 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:12:01,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7b5eb6b0a094c7d42172c45a1a1d2178, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:01,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0a4138d8110b1da3cb882f1fb6d5ca75, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:01,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498721410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498721410"}]},"ts":"1689498721410"} 2023-07-16 09:12:01,410 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498721410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498721410"}]},"ts":"1689498721410"} 2023-07-16 09:12:01,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 7b5eb6b0a094c7d42172c45a1a1d2178, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:12:01,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 0a4138d8110b1da3cb882f1fb6d5ca75, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:01,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:01,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b5eb6b0a094c7d42172c45a1a1d2178, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 09:12:01,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. service=AccessControlService 2023-07-16 09:12:01,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,570 INFO [StoreOpener-7b5eb6b0a094c7d42172c45a1a1d2178-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a4138d8110b1da3cb882f1fb6d5ca75, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 09:12:01,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. service=AccessControlService 2023-07-16 09:12:01,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:01,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:01,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,575 DEBUG [StoreOpener-7b5eb6b0a094c7d42172c45a1a1d2178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf 2023-07-16 09:12:01,575 DEBUG [StoreOpener-7b5eb6b0a094c7d42172c45a1a1d2178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf 2023-07-16 09:12:01,575 INFO [StoreOpener-0a4138d8110b1da3cb882f1fb6d5ca75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,575 INFO [StoreOpener-7b5eb6b0a094c7d42172c45a1a1d2178-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b5eb6b0a094c7d42172c45a1a1d2178 columnFamilyName cf 2023-07-16 09:12:01,579 INFO [StoreOpener-7b5eb6b0a094c7d42172c45a1a1d2178-1] regionserver.HStore(310): Store=7b5eb6b0a094c7d42172c45a1a1d2178/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:01,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,580 DEBUG [StoreOpener-0a4138d8110b1da3cb882f1fb6d5ca75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf 2023-07-16 09:12:01,580 DEBUG [StoreOpener-0a4138d8110b1da3cb882f1fb6d5ca75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf 2023-07-16 09:12:01,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,580 INFO [StoreOpener-0a4138d8110b1da3cb882f1fb6d5ca75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a4138d8110b1da3cb882f1fb6d5ca75 columnFamilyName cf 2023-07-16 09:12:01,581 INFO [StoreOpener-0a4138d8110b1da3cb882f1fb6d5ca75-1] regionserver.HStore(310): Store=0a4138d8110b1da3cb882f1fb6d5ca75/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:01,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:01,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:01,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b5eb6b0a094c7d42172c45a1a1d2178; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69371421, jitterRate=0.03371472656726837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:01,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b5eb6b0a094c7d42172c45a1a1d2178: 2023-07-16 09:12:01,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:01,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a4138d8110b1da3cb882f1fb6d5ca75; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66664926, jitterRate=-0.006615191698074341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:01,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a4138d8110b1da3cb882f1fb6d5ca75: 2023-07-16 09:12:01,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75., pid=70, masterSystemTime=1689498721569 2023-07-16 09:12:01,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178., pid=69, masterSystemTime=1689498721564 2023-07-16 09:12:01,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:01,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0a4138d8110b1da3cb882f1fb6d5ca75, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:01,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,592 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721591"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498721591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498721591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498721591"}]},"ts":"1689498721591"} 2023-07-16 09:12:01,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:01,592 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7b5eb6b0a094c7d42172c45a1a1d2178, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:01,592 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498721592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498721592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498721592"}]},"ts":"1689498721592"} 2023-07-16 09:12:01,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-16 09:12:01,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 0a4138d8110b1da3cb882f1fb6d5ca75, server=jenkins-hbase4.apache.org,46593,1689498639060 in 179 msec 2023-07-16 09:12:01,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-16 09:12:01,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 7b5eb6b0a094c7d42172c45a1a1d2178, server=jenkins-hbase4.apache.org,34051,1689498639118 in 183 msec 2023-07-16 09:12:01,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, ASSIGN in 344 msec 2023-07-16 09:12:01,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-16 09:12:01,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, ASSIGN in 345 msec 2023-07-16 09:12:01,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:12:01,600 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498721600"}]},"ts":"1689498721600"} 2023-07-16 09:12:01,601 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 09:12:01,605 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:12:01,605 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 09:12:01,607 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 09:12:01,608 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:01,608 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:01,609 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:01,609 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:01,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:01,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 456 msec 2023-07-16 09:12:01,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:01,768 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 09:12:01,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 0a4138d8110b1da3cb882f1fb6d5ca75, 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:01,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0a4138d8110b1da3cb882f1fb6d5ca75, 7b5eb6b0a094c7d42172c45a1a1d2178], force=true 2023-07-16 09:12:01,817 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0a4138d8110b1da3cb882f1fb6d5ca75, 7b5eb6b0a094c7d42172c45a1a1d2178], force=true 2023-07-16 09:12:01,817 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0a4138d8110b1da3cb882f1fb6d5ca75, 7b5eb6b0a094c7d42172c45a1a1d2178], force=true 2023-07-16 09:12:01,817 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0a4138d8110b1da3cb882f1fb6d5ca75, 7b5eb6b0a094c7d42172c45a1a1d2178], force=true 2023-07-16 09:12:01,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:01,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, UNASSIGN}] 2023-07-16 09:12:01,851 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, UNASSIGN 2023-07-16 09:12:01,852 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, UNASSIGN 2023-07-16 09:12:01,853 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7b5eb6b0a094c7d42172c45a1a1d2178, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:01,853 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0a4138d8110b1da3cb882f1fb6d5ca75, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:01,853 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498721853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498721853"}]},"ts":"1689498721853"} 2023-07-16 09:12:01,853 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498721853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498721853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498721853"}]},"ts":"1689498721853"} 2023-07-16 09:12:01,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 7b5eb6b0a094c7d42172c45a1a1d2178, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:12:01,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 0a4138d8110b1da3cb882f1fb6d5ca75, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:01,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:02,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:02,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b5eb6b0a094c7d42172c45a1a1d2178, disabling compactions & flushes 2023-07-16 09:12:02,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:02,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:02,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. after waiting 0 ms 2023-07-16 09:12:02,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:02,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7b5eb6b0a094c7d42172c45a1a1d2178 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 09:12:02,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:02,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a4138d8110b1da3cb882f1fb6d5ca75, disabling compactions & flushes 2023-07-16 09:12:02,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:02,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:02,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. after waiting 0 ms 2023-07-16 09:12:02,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:02,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0a4138d8110b1da3cb882f1fb6d5ca75 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 09:12:02,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/.tmp/cf/b2bbf4e508e04e42838add535bd3d522 2023-07-16 09:12:02,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/.tmp/cf/b2bbf4e508e04e42838add535bd3d522 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf/b2bbf4e508e04e42838add535bd3d522 2023-07-16 09:12:02,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf/b2bbf4e508e04e42838add535bd3d522, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 09:12:02,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7b5eb6b0a094c7d42172c45a1a1d2178 in 49ms, sequenceid=5, compaction requested=false 2023-07-16 09:12:02,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 09:12:02,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/.tmp/cf/6b5103891b164624a5bed0a970e3040a 2023-07-16 09:12:02,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 09:12:02,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/.tmp/cf/6b5103891b164624a5bed0a970e3040a as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf/6b5103891b164624a5bed0a970e3040a 2023-07-16 09:12:02,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:02,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178. 2023-07-16 09:12:02,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b5eb6b0a094c7d42172c45a1a1d2178: 2023-07-16 09:12:02,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:02,104 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7b5eb6b0a094c7d42172c45a1a1d2178, regionState=CLOSED 2023-07-16 09:12:02,104 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498722104"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498722104"}]},"ts":"1689498722104"} 2023-07-16 09:12:02,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-16 09:12:02,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 7b5eb6b0a094c7d42172c45a1a1d2178, server=jenkins-hbase4.apache.org,34051,1689498639118 in 251 msec 2023-07-16 09:12:02,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b5eb6b0a094c7d42172c45a1a1d2178, UNASSIGN in 262 msec 2023-07-16 09:12:02,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf/6b5103891b164624a5bed0a970e3040a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 09:12:02,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0a4138d8110b1da3cb882f1fb6d5ca75 in 88ms, sequenceid=5, compaction requested=false 2023-07-16 09:12:02,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:02,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 09:12:02,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:02,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75. 2023-07-16 09:12:02,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a4138d8110b1da3cb882f1fb6d5ca75: 2023-07-16 09:12:02,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:02,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0a4138d8110b1da3cb882f1fb6d5ca75, regionState=CLOSED 2023-07-16 09:12:02,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498722155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498722155"}]},"ts":"1689498722155"} 2023-07-16 09:12:02,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-16 09:12:02,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 0a4138d8110b1da3cb882f1fb6d5ca75, server=jenkins-hbase4.apache.org,46593,1689498639060 in 305 msec 2023-07-16 09:12:02,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-16 09:12:02,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0a4138d8110b1da3cb882f1fb6d5ca75, UNASSIGN in 323 msec 2023-07-16 09:12:02,275 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 09:12:02,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721155.0a4138d8110b1da3cb882f1fb6d5ca75.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:02,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498721155.7b5eb6b0a094c7d42172c45a1a1d2178.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:02,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:02,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, ASSIGN}] 2023-07-16 09:12:02,351 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, ASSIGN 2023-07-16 09:12:02,352 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46593,1689498639060; forceNewPlan=false, retain=false 2023-07-16 09:12:02,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:02,503 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 09:12:02,505 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4e44f7473b02bf526168a4c16d3361ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:02,505 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498722505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498722505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498722505"}]},"ts":"1689498722505"} 2023-07-16 09:12:02,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4e44f7473b02bf526168a4c16d3361ec, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:02,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:02,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e44f7473b02bf526168a4c16d3361ec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:12:02,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. service=AccessControlService 2023-07-16 09:12:02,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:02,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:02,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0004_000001 (auth:SIMPLE) 2023-07-16 09:12:02,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/.regioninfo 2023-07-16 09:12:02,719 INFO [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,723 DEBUG [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf 2023-07-16 09:12:02,723 DEBUG [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf 2023-07-16 09:12:02,724 INFO [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e44f7473b02bf526168a4c16d3361ec columnFamilyName cf 2023-07-16 09:12:02,760 DEBUG [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] regionserver.HStore(539): loaded hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/6b5103891b164624a5bed0a970e3040a.0a4138d8110b1da3cb882f1fb6d5ca75->hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf/6b5103891b164624a5bed0a970e3040a-top 2023-07-16 09:12:02,768 DEBUG [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] regionserver.HStore(539): loaded hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/b2bbf4e508e04e42838add535bd3d522.7b5eb6b0a094c7d42172c45a1a1d2178->hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf/b2bbf4e508e04e42838add535bd3d522-top 2023-07-16 09:12:02,769 INFO [StoreOpener-4e44f7473b02bf526168a4c16d3361ec-1] regionserver.HStore(310): Store=4e44f7473b02bf526168a4c16d3361ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:02,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:02,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e44f7473b02bf526168a4c16d3361ec; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70277863, jitterRate=0.04722176492214203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:02,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e44f7473b02bf526168a4c16d3361ec: 2023-07-16 09:12:02,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec., pid=77, masterSystemTime=1689498722659 2023-07-16 09:12:02,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.,because compaction is disabled. 2023-07-16 09:12:02,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:02,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:02,784 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4e44f7473b02bf526168a4c16d3361ec, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:02,784 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498722784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498722784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498722784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498722784"}]},"ts":"1689498722784"} 2023-07-16 09:12:02,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 09:12:02,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4e44f7473b02bf526168a4c16d3361ec, server=jenkins-hbase4.apache.org,46593,1689498639060 in 284 msec 2023-07-16 09:12:02,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 09:12:02,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, ASSIGN in 450 msec 2023-07-16 09:12:02,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0a4138d8110b1da3cb882f1fb6d5ca75, 7b5eb6b0a094c7d42172c45a1a1d2178], force=true in 996 msec 2023-07-16 09:12:02,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:02,929 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 09:12:02,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 09:12:02,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498722930 (current time:1689498722930). 2023-07-16 09:12:02,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:02,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x7435588b to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:02,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd74a57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:02,944 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:02,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7435588b to 127.0.0.1:59352 2023-07-16 09:12:02,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:02,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x62f9b81c to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:02,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cd645c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:03,058 DEBUG [hconnection-0x7b9425f7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:03,064 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:03,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:03,083 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:03,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62f9b81c to 127.0.0.1:59352 2023-07-16 09:12:03,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:03,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 09:12:03,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:03,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 09:12:03,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 09:12:03,098 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 09:12:03,099 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689499323099 2023-07-16 09:12:03,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 09:12:03,104 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:03,104 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:03,106 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 09:12:03,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 09:12:03,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-16 09:12:03,112 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 09:12:03,113 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689499323113 2023-07-16 09:12:03,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,164 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 09:12:03,164 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:03,166 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 09:12:03,166 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 09:12:03,167 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,167 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,204 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:03,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:03,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:03,206 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:03,227 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:03,227 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:03,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:03,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:03,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:03,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:03,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 09:12:03,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 09:12:03,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,229 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 09:12:03,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,229 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:03,229 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 09:12:03,229 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:03,231 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:03,231 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:03,231 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,231 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,234 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 09:12:03,234 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 09:12:03,234 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 09:12:03,234 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 09:12:03,234 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 09:12:03,234 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 09:12:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 09:12:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,235 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 09:12:03,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,235 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 09:12:03,235 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:03,237 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 09:12:03,237 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 09:12:03,237 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 09:12:03,265 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,265 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:03,315 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:03,315 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,316 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 09:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cdae1b3[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:03,325 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 09:12:03,325 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,350 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 09:12:03,350 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 09:12:03,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:12:03,350 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:03,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 09:12:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 09:12:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 09:12:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:12:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:03,355 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:03,355 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. started... 2023-07-16 09:12:03,357 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e44f7473b02bf526168a4c16d3361ec: 2023-07-16 09:12:03,358 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,358 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:03,359 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/6b5103891b164624a5bed0a970e3040a.0a4138d8110b1da3cb882f1fb6d5ca75->hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf/6b5103891b164624a5bed0a970e3040a-top, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/b2bbf4e508e04e42838add535bd3d522.7b5eb6b0a094c7d42172c45a1a1d2178->hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf/b2bbf4e508e04e42838add535bd3d522-top] hfiles 2023-07-16 09:12:03,359 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/6b5103891b164624a5bed0a970e3040a.0a4138d8110b1da3cb882f1fb6d5ca75 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,360 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/b2bbf4e508e04e42838add535bd3d522.7b5eb6b0a094c7d42172c45a1a1d2178 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,373 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 09:12:03,373 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:03,373 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 09:12:03,406 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:03,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:03,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:03,408 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:03,419 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 09:12:03,419 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:03,419 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 09:12:03,447 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. completed. 2023-07-16 09:12:03,447 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:03,447 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:03,447 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:03,447 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,447 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 09:12:03,447 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:12:03,612 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,612 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 09:12:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:03,612 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:03,612 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 09:12:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:03,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:12:03,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 09:12:03,616 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 09:12:03,616 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:03,616 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:03,616 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,616 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:03,657 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,657 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,657 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,657 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:03,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,658 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:03,658 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:03,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:03,658 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:03,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:03,659 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,660 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,662 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,663 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,663 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,688 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:03,689 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:03,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:03,689 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:03,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,689 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:03,689 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:03,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:03,689 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:03,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:03,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:03,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,689 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:03,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:03,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:03,698 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,699 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,708 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:03,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:03,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:03,709 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:12:03,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,832 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:03,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 09:12:03,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,972 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:03,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689498723099Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498723689 (+590 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498723689Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498723707 (+18 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498723821 (+114 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689498723972 (+151 ms) 2023-07-16 09:12:03,976 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 09:12:03,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 872 msec 2023-07-16 09:12:04,210 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:04,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:04,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:04,211 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211 2023-07-16 09:12:04,211 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33301, tgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211, rawTgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:12:04,237 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:12:04,237 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-507714873_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:04,237 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 09:12:04,246 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:04,321 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,321 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,483 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-903233432799696708.jar 2023-07-16 09:12:04,484 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,484 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,484 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,485 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,485 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,485 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:04,485 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:12:04,486 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:12:04,486 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:12:04,487 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:12:04,487 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:12:04,487 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:12:04,488 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:12:04,488 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:12:04,488 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:12:04,489 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:12:04,489 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:04,489 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:04,490 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:04,490 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:04,490 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:04,491 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:04,491 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:05,422 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:12:05,425 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 09:12:05,427 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 09:12:05,485 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:05,486 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:05,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:11,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:13,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:17,148 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:18,736 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:12:18,740 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:12:18,763 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:18,763 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:12:18,764 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:12:18,764 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:18,765 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 09:12:18,765 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 09:12:18,765 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:18,766 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 09:12:18,766 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498724211/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 09:12:18,776 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:18,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:18,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:18,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 09:12:18,782 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498738782"}]},"ts":"1689498738782"} 2023-07-16 09:12:18,783 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 09:12:18,785 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 09:12:18,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, UNASSIGN}] 2023-07-16 09:12:18,788 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, UNASSIGN 2023-07-16 09:12:18,789 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4e44f7473b02bf526168a4c16d3361ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:18,789 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498738789"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498738789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498738789"}]},"ts":"1689498738789"} 2023-07-16 09:12:18,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4e44f7473b02bf526168a4c16d3361ec, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:18,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 09:12:18,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:18,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e44f7473b02bf526168a4c16d3361ec, disabling compactions & flushes 2023-07-16 09:12:18,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:18,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:18,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. after waiting 0 ms 2023-07-16 09:12:18,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:18,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 09:12:18,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:18,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec. 2023-07-16 09:12:18,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e44f7473b02bf526168a4c16d3361ec: 2023-07-16 09:12:18,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:18,959 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4e44f7473b02bf526168a4c16d3361ec, regionState=CLOSED 2023-07-16 09:12:18,959 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498738959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498738959"}]},"ts":"1689498738959"} 2023-07-16 09:12:18,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 09:12:18,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4e44f7473b02bf526168a4c16d3361ec, server=jenkins-hbase4.apache.org,46593,1689498639060 in 171 msec 2023-07-16 09:12:18,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 09:12:18,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e44f7473b02bf526168a4c16d3361ec, UNASSIGN in 176 msec 2023-07-16 09:12:18,965 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498738965"}]},"ts":"1689498738965"} 2023-07-16 09:12:18,966 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 09:12:18,968 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 09:12:18,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 192 msec 2023-07-16 09:12:19,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 09:12:19,085 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 09:12:19,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,093 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,095 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,097 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,100 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,100 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,100 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,100 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 09:12:19,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 09:12:19,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 09:12:19,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,103 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 09:12:19,106 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:19,106 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:19,107 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:19,107 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:19,115 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:19,116 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:19,117 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/recovered.edits] 2023-07-16 09:12:19,118 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/recovered.edits] 2023-07-16 09:12:19,121 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:19,129 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf/b2bbf4e508e04e42838add535bd3d522 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/cf/b2bbf4e508e04e42838add535bd3d522 2023-07-16 09:12:19,129 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/recovered.edits] 2023-07-16 09:12:19,133 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/recovered.edits/8.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178/recovered.edits/8.seqid 2023-07-16 09:12:19,134 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/6b5103891b164624a5bed0a970e3040a.0a4138d8110b1da3cb882f1fb6d5ca75 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/6b5103891b164624a5bed0a970e3040a.0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:19,134 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:19,137 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf/6b5103891b164624a5bed0a970e3040a to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/cf/6b5103891b164624a5bed0a970e3040a 2023-07-16 09:12:19,138 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/b2bbf4e508e04e42838add535bd3d522.7b5eb6b0a094c7d42172c45a1a1d2178 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/cf/b2bbf4e508e04e42838add535bd3d522.7b5eb6b0a094c7d42172c45a1a1d2178 2023-07-16 09:12:19,144 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/recovered.edits/8.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75/recovered.edits/8.seqid 2023-07-16 09:12:19,144 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0a4138d8110b1da3cb882f1fb6d5ca75 2023-07-16 09:12:19,149 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/recovered.edits/12.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec/recovered.edits/12.seqid 2023-07-16 09:12:19,150 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e44f7473b02bf526168a4c16d3361ec 2023-07-16 09:12:19,150 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 09:12:19,153 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,167 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 09:12:19,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 09:12:19,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 09:12:19,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498739174"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:19,185 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 09:12:19,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4e44f7473b02bf526168a4c16d3361ec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498721156.4e44f7473b02bf526168a4c16d3361ec.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 09:12:19,185 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 09:12:19,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498739185"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:19,193 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 09:12:19,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,199 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 111 msec 2023-07-16 09:12:19,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 09:12:19,206 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 09:12:19,209 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,214 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498739214"}]},"ts":"1689498739214"} 2023-07-16 09:12:19,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 09:12:19,216 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 09:12:19,218 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 09:12:19,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, UNASSIGN}] 2023-07-16 09:12:19,222 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, UNASSIGN 2023-07-16 09:12:19,222 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, UNASSIGN 2023-07-16 09:12:19,225 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=558c0246ac3a6220592cf40077df0391, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:19,225 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a26b781b228f29f73b2ab2d7af475504, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:19,225 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498739225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498739225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498739225"}]},"ts":"1689498739225"} 2023-07-16 09:12:19,225 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498739225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498739225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498739225"}]},"ts":"1689498739225"} 2023-07-16 09:12:19,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 558c0246ac3a6220592cf40077df0391, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:19,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure a26b781b228f29f73b2ab2d7af475504, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:12:19,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 09:12:19,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 558c0246ac3a6220592cf40077df0391 2023-07-16 09:12:19,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:12:19,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 558c0246ac3a6220592cf40077df0391, disabling compactions & flushes 2023-07-16 09:12:19,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a26b781b228f29f73b2ab2d7af475504, disabling compactions & flushes 2023-07-16 09:12:19,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:12:19,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:12:19,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:12:19,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:12:19,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. after waiting 0 ms 2023-07-16 09:12:19,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. after waiting 0 ms 2023-07-16 09:12:19,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:12:19,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:12:19,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:19,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:19,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:19,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504. 2023-07-16 09:12:19,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a26b781b228f29f73b2ab2d7af475504: 2023-07-16 09:12:19,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:19,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391. 2023-07-16 09:12:19,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 558c0246ac3a6220592cf40077df0391: 2023-07-16 09:12:19,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 558c0246ac3a6220592cf40077df0391 2023-07-16 09:12:19,437 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a26b781b228f29f73b2ab2d7af475504, regionState=CLOSED 2023-07-16 09:12:19,437 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498739437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498739437"}]},"ts":"1689498739437"} 2023-07-16 09:12:19,439 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=558c0246ac3a6220592cf40077df0391, regionState=CLOSED 2023-07-16 09:12:19,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498739438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498739438"}]},"ts":"1689498739438"} 2023-07-16 09:12:19,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:12:19,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-16 09:12:19,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 558c0246ac3a6220592cf40077df0391, server=jenkins-hbase4.apache.org,46593,1689498639060 in 213 msec 2023-07-16 09:12:19,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-16 09:12:19,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure a26b781b228f29f73b2ab2d7af475504, server=jenkins-hbase4.apache.org,36871,1689498639173 in 212 msec 2023-07-16 09:12:19,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=558c0246ac3a6220592cf40077df0391, UNASSIGN in 226 msec 2023-07-16 09:12:19,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-16 09:12:19,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a26b781b228f29f73b2ab2d7af475504, UNASSIGN in 232 msec 2023-07-16 09:12:19,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498739455"}]},"ts":"1689498739455"} 2023-07-16 09:12:19,457 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 09:12:19,461 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 09:12:19,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 253 msec 2023-07-16 09:12:19,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 09:12:19,518 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 09:12:19,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,525 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,526 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,527 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,534 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 2023-07-16 09:12:19,534 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:12:19,537 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/recovered.edits] 2023-07-16 09:12:19,539 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/recovered.edits] 2023-07-16 09:12:19,546 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf/ac9694f2a57b443785f046f97ae629f5 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/cf/ac9694f2a57b443785f046f97ae629f5 2023-07-16 09:12:19,556 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/cf/6a6d936d2a4c4725aabc3c6a94d8e5ae 2023-07-16 09:12:19,564 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391/recovered.edits/9.seqid 2023-07-16 09:12:19,565 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504/recovered.edits/9.seqid 2023-07-16 09:12:19,565 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a26b781b228f29f73b2ab2d7af475504 2023-07-16 09:12:19,566 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/558c0246ac3a6220592cf40077df0391 2023-07-16 09:12:19,566 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 09:12:19,569 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,572 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 09:12:19,575 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 09:12:19,576 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,576 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 09:12:19,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498739576"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:19,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498739576"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:19,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:12:19,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 558c0246ac3a6220592cf40077df0391, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718543.558c0246ac3a6220592cf40077df0391.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a26b781b228f29f73b2ab2d7af475504, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718543.a26b781b228f29f73b2ab2d7af475504.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:12:19,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 09:12:19,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498739578"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:19,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 09:12:19,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,595 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:19,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:19,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:19,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:19,604 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 83 msec 2023-07-16 09:12:19,610 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,610 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,610 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,610 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,611 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,611 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,611 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,611 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:19,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 09:12:19,612 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 09:12:19,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 09:12:19,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 09:12:19,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:19,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 09:12:19,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:19,702 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 751) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:33412 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:39197 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:41918 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:38538 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:41930 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1879917026_1 at /127.0.0.1:41902 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4066 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 914), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=695 (was 512) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2643 (was 3334) 2023-07-16 09:12:19,703 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 09:12:19,738 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=695, ProcessCount=186, AvailableMemoryMB=2635 2023-07-16 09:12:19,738 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 09:12:19,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:12:19,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:19,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:12:19,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 09:12:19,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:12:19,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:19,749 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:19,749 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:19,750 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd empty. 2023-07-16 09:12:19,750 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 empty. 2023-07-16 09:12:19,751 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:19,751 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:19,751 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 09:12:19,803 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 09:12:19,811 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b769b1a7161783f077afd8b8da7a871, NAME => 'testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:12:19,819 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 143b9c81ebd4a8ee360b27cbda2a70dd, NAME => 'testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:12:19,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:19,920 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:19,920 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 143b9c81ebd4a8ee360b27cbda2a70dd, disabling compactions & flushes 2023-07-16 09:12:19,920 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:19,920 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:19,920 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. after waiting 0 ms 2023-07-16 09:12:19,920 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:19,920 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:19,920 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 143b9c81ebd4a8ee360b27cbda2a70dd: 2023-07-16 09:12:19,923 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:19,924 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2b769b1a7161783f077afd8b8da7a871, disabling compactions & flushes 2023-07-16 09:12:19,924 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:19,924 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:19,924 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. after waiting 0 ms 2023-07-16 09:12:19,924 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:19,924 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:19,924 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2b769b1a7161783f077afd8b8da7a871: 2023-07-16 09:12:19,926 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:12:19,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498739927"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498739927"}]},"ts":"1689498739927"} 2023-07-16 09:12:19,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498739927"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498739927"}]},"ts":"1689498739927"} 2023-07-16 09:12:19,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:12:19,930 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:12:19,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498739930"}]},"ts":"1689498739930"} 2023-07-16 09:12:19,932 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 09:12:19,935 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:12:19,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:12:19,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:12:19,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:12:19,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:12:19,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, ASSIGN}] 2023-07-16 09:12:19,945 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, ASSIGN 2023-07-16 09:12:19,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, ASSIGN 2023-07-16 09:12:19,948 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34051,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:12:19,949 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36871,1689498639173; forceNewPlan=false, retain=false 2023-07-16 09:12:20,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:20,099 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:12:20,103 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2b769b1a7161783f077afd8b8da7a871, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498740102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498740102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498740102"}]},"ts":"1689498740102"} 2023-07-16 09:12:20,103 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=143b9c81ebd4a8ee360b27cbda2a70dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498740103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498740103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498740103"}]},"ts":"1689498740103"} 2023-07-16 09:12:20,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 2b769b1a7161783f077afd8b8da7a871, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:12:20,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 143b9c81ebd4a8ee360b27cbda2a70dd, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:12:20,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:20,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b769b1a7161783f077afd8b8da7a871, NAME => 'testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:12:20,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. service=AccessControlService 2023-07-16 09:12:20,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:20,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:20,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 143b9c81ebd4a8ee360b27cbda2a70dd, NAME => 'testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:12:20,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. service=AccessControlService 2023-07-16 09:12:20,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:20,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:20,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:20,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,281 INFO [StoreOpener-2b769b1a7161783f077afd8b8da7a871-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,282 INFO [StoreOpener-143b9c81ebd4a8ee360b27cbda2a70dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,284 DEBUG [StoreOpener-2b769b1a7161783f077afd8b8da7a871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf 2023-07-16 09:12:20,284 DEBUG [StoreOpener-2b769b1a7161783f077afd8b8da7a871-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf 2023-07-16 09:12:20,285 INFO [StoreOpener-2b769b1a7161783f077afd8b8da7a871-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b769b1a7161783f077afd8b8da7a871 columnFamilyName cf 2023-07-16 09:12:20,286 DEBUG [StoreOpener-143b9c81ebd4a8ee360b27cbda2a70dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf 2023-07-16 09:12:20,286 INFO [StoreOpener-2b769b1a7161783f077afd8b8da7a871-1] regionserver.HStore(310): Store=2b769b1a7161783f077afd8b8da7a871/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:20,286 DEBUG [StoreOpener-143b9c81ebd4a8ee360b27cbda2a70dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf 2023-07-16 09:12:20,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,288 INFO [StoreOpener-143b9c81ebd4a8ee360b27cbda2a70dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 143b9c81ebd4a8ee360b27cbda2a70dd columnFamilyName cf 2023-07-16 09:12:20,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,289 INFO [StoreOpener-143b9c81ebd4a8ee360b27cbda2a70dd-1] regionserver.HStore(310): Store=143b9c81ebd4a8ee360b27cbda2a70dd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:20,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:20,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:20,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:20,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 143b9c81ebd4a8ee360b27cbda2a70dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69446279, jitterRate=0.03483019769191742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:20,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 143b9c81ebd4a8ee360b27cbda2a70dd: 2023-07-16 09:12:20,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd., pid=94, masterSystemTime=1689498740260 2023-07-16 09:12:20,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:20,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:20,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:20,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2b769b1a7161783f077afd8b8da7a871; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65623283, jitterRate=-0.022136881947517395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:20,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2b769b1a7161783f077afd8b8da7a871: 2023-07-16 09:12:20,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=143b9c81ebd4a8ee360b27cbda2a70dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,306 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498740305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498740305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498740305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498740305"}]},"ts":"1689498740305"} 2023-07-16 09:12:20,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871., pid=93, masterSystemTime=1689498740259 2023-07-16 09:12:20,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:20,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:20,314 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2b769b1a7161783f077afd8b8da7a871, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,314 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498740314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498740314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498740314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498740314"}]},"ts":"1689498740314"} 2023-07-16 09:12:20,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-16 09:12:20,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 143b9c81ebd4a8ee360b27cbda2a70dd, server=jenkins-hbase4.apache.org,34051,1689498639118 in 201 msec 2023-07-16 09:12:20,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, ASSIGN in 379 msec 2023-07-16 09:12:20,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-16 09:12:20,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 2b769b1a7161783f077afd8b8da7a871, server=jenkins-hbase4.apache.org,36871,1689498639173 in 211 msec 2023-07-16 09:12:20,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-16 09:12:20,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, ASSIGN in 381 msec 2023-07-16 09:12:20,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:12:20,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498740321"}]},"ts":"1689498740321"} 2023-07-16 09:12:20,322 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 09:12:20,325 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:12:20,325 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 09:12:20,326 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:12:20,328 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:20,330 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:20,330 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:20,330 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:20,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:20,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:20,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:20,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:20,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 591 msec 2023-07-16 09:12:20,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:20,351 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 09:12:20,352 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 09:12:20,352 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:20,367 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 09:12:20,367 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:20,367 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-16 09:12:20,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:20,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498740394 (current time:1689498740394). 2023-07-16 09:12:20,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:20,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x220a8b71 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:20,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d0e338b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:20,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:20,443 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x220a8b71 to 127.0.0.1:59352 2023-07-16 09:12:20,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:20,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x1558cc37 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:20,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637f8cee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:20,506 DEBUG [hconnection-0x7f716961-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:20,507 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:20,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:20,522 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:20,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1558cc37 to 127.0.0.1:59352 2023-07-16 09:12:20,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:20,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:12:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:20,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:20,537 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:20,538 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499340538 2023-07-16 09:12:20,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:20,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:20,541 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:20,541 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:20,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:20,542 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:20,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-16 09:12:20,547 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:20,548 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499340548 2023-07-16 09:12:20,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,573 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 09:12:20,573 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,575 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 09:12:20,575 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:12:20,576 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,576 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,582 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,582 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:20,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:20,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,587 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 09:12:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,589 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:20,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,598 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:20,613 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,613 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:20,613 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:20,613 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:20,615 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:20,616 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,616 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,617 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,617 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:20,620 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,621 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,621 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,621 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:20,621 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,621 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:20,624 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:20,625 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,629 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,630 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,630 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:20,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:20,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:20,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64562a23[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:20,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:20,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:20,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:20,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:20,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:20,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64562a23[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:20,635 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:12:20,635 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,638 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:20,638 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:20,638 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,639 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,639 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:20,641 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:20,642 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:20,642 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:20,642 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:20,642 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. started... 2023-07-16 09:12:20,644 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 143b9c81ebd4a8ee360b27cbda2a70dd: 2023-07-16 09:12:20,644 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,644 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:20,644 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:20,645 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:20,645 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,645 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:20,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,645 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:20,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:20,646 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:20,646 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:20,646 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:12:20,646 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. started... 2023-07-16 09:12:20,646 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:20,649 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b769b1a7161783f077afd8b8da7a871: 2023-07-16 09:12:20,649 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,649 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:20,649 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:20,650 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:20,650 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:20,650 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:20,691 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. completed. 2023-07-16 09:12:20,691 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:20,691 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:20,699 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:20,699 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,699 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:20,699 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:12:20,702 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:20,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:20,702 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:20,704 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. completed. 2023-07-16 09:12:20,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:20,704 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:20,705 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:20,705 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:20,705 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,705 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:20,705 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:12:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:20,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,706 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,706 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:20,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:20,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:12:20,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:12:20,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:20,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:20,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:20,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:20,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:20,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:12:20,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:12:20,716 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 09:12:20,716 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:20,716 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:20,716 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,716 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:20,719 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:20,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,719 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,720 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:20,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,720 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:20,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:20,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:20,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,721 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:20,721 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,722 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,724 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,725 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,725 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,728 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,728 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,728 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,728 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:20,728 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,728 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:20,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:20,729 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,731 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,729 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,731 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:20,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:20,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:20,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:20,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:20,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 09:12:20,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,843 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689498740538Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689498740731 (+193 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689498740731Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689498740747 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689498740790 (+43 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689498740842 (+52 ms) 2023-07-16 09:12:20,846 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:20,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 306 msec 2023-07-16 09:12:20,848 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:20,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:20,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34051] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:20,865 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:20,865 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:20,865 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:20,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:20,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498740880 (current time:1689498740880). 2023-07-16 09:12:20,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:20,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x6f92c842 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:20,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b5c9eb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:20,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:20,889 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:20,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f92c842 to 127.0.0.1:59352 2023-07-16 09:12:20,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:20,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x1a7e0f2a to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:20,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@635714ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:20,911 DEBUG [hconnection-0x1c81af3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:20,914 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:20,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:20,922 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a7e0f2a to 127.0.0.1:59352 2023-07-16 09:12:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:12:20,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:20,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:20,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:20,929 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:20,930 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499340930 2023-07-16 09:12:20,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:20,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:20,932 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:20,932 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:20,936 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:20,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:20,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-16 09:12:20,940 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:20,941 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499340941 2023-07-16 09:12:20,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,975 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 09:12:20,975 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,977 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 09:12:20,977 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:12:20,977 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,977 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,979 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,979 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,979 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,979 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:20,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:20,979 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,979 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:20,980 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,981 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:20,981 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:20,981 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 09:12:20,981 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:20,990 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:20,991 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,991 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:20,993 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,993 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:20,993 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:20,994 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,994 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:20,996 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:20,996 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:20,996 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:21,004 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,004 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:21,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ac2d1b[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:21,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:21,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ac2d1b[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:21,008 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:12:21,008 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:21,014 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:12:21,015 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,015 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:21,017 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:21,018 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:21,024 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:21,024 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:21,024 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:21,024 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:21,024 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:21,024 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. started... 2023-07-16 09:12:21,024 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. started... 2023-07-16 09:12:21,025 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2b769b1a7161783f077afd8b8da7a871 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 09:12:21,025 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 143b9c81ebd4a8ee360b27cbda2a70dd 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 09:12:21,032 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:21,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:21,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:21,034 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:21,074 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/.tmp/cf/d2b5f1261c0b4356b7369ea5bc89a51b 2023-07-16 09:12:21,090 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/.tmp/cf/d2b5f1261c0b4356b7369ea5bc89a51b as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf/d2b5f1261c0b4356b7369ea5bc89a51b 2023-07-16 09:12:21,096 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf/d2b5f1261c0b4356b7369ea5bc89a51b, entries=46, sequenceid=6, filesize=7.9 K 2023-07-16 09:12:21,102 INFO [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 143b9c81ebd4a8ee360b27cbda2a70dd in 76ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:21,102 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 09:12:21,103 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 143b9c81ebd4a8ee360b27cbda2a70dd: 2023-07-16 09:12:21,103 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,103 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:21,103 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf/d2b5f1261c0b4356b7369ea5bc89a51b] hfiles 2023-07-16 09:12:21,103 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf/d2b5f1261c0b4356b7369ea5bc89a51b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,115 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/.tmp/cf/4955fc8e8faa461d9b4622c7fddb42fe 2023-07-16 09:12:21,133 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/.tmp/cf/4955fc8e8faa461d9b4622c7fddb42fe as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf/4955fc8e8faa461d9b4622c7fddb42fe 2023-07-16 09:12:21,142 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf/4955fc8e8faa461d9b4622c7fddb42fe, entries=4, sequenceid=6, filesize=5.1 K 2023-07-16 09:12:21,143 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2b769b1a7161783f077afd8b8da7a871 in 118ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:21,157 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b769b1a7161783f077afd8b8da7a871: 2023-07-16 09:12:21,157 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,160 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:21,160 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf/4955fc8e8faa461d9b4622c7fddb42fe] hfiles 2023-07-16 09:12:21,160 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf/4955fc8e8faa461d9b4622c7fddb42fe for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,164 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. completed. 2023-07-16 09:12:21,164 DEBUG [rs(jenkins-hbase4.apache.org,34051,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:12:21,167 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:21,167 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,167 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:21,167 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34051,1689498639118': 2023-07-16 09:12:21,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:12:21,195 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. completed. 2023-07-16 09:12:21,195 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:21,195 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:21,195 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:21,195 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,195 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:21,195 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:12:21,197 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:21,197 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,197 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:21,197 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:21,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:21,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:12:21,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:12:21,202 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 09:12:21,203 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:21,203 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:21,203 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,203 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:21,205 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,205 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:21,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,205 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,205 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:21,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,205 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,206 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:21,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,206 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:21,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:21,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:21,207 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:21,207 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:21,208 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,210 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,210 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,211 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:21,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:21,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,216 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:21,215 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:21,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:21,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:21,217 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:21,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:21,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,238 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:21,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:21,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:21,240 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:21,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 09:12:21,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,385 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689498740930Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689498741219 (+289 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689498741219Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689498741254 (+35 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689498741329 (+75 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689498741384 (+55 ms) 2023-07-16 09:12:21,389 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:21,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 458 msec 2023-07-16 09:12:21,540 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:21,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:21,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:21,542 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542 2023-07-16 09:12:21,542 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33301, tgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542, rawTgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:12:21,566 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:12:21,566 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_893085181_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:21,566 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 09:12:21,576 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:22,039 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,039 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,040 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,040 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,041 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,041 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,041 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,149 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-4405970995064283977.jar 2023-07-16 09:12:22,150 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,150 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,151 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,151 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,152 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,152 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:22,153 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:12:22,153 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:12:22,154 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:12:22,155 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:12:22,155 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:12:22,156 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:12:22,156 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:12:22,157 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:12:22,157 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:12:22,158 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:12:22,159 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:22,159 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:22,160 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:22,160 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:22,160 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:22,161 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:22,161 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:23,023 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:12:23,026 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 09:12:23,381 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:23,381 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:23,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:23,444 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0006_000001 (auth:SIMPLE) 2023-07-16 09:12:24,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:28,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0006_000001 (auth:SIMPLE) 2023-07-16 09:12:31,500 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:12:31,501 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:12:31,506 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:31,506 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:12:31,507 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:12:31,507 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:31,507 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 09:12:31,507 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 09:12:31,507 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:31,508 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 09:12:31,508 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498741542/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 09:12:31,513 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 09:12:31,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 09:12:31,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:31,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:31,518 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498751518"}]},"ts":"1689498751518"} 2023-07-16 09:12:31,519 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 09:12:31,558 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 09:12:31,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, UNASSIGN}] 2023-07-16 09:12:31,562 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, UNASSIGN 2023-07-16 09:12:31,562 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, UNASSIGN 2023-07-16 09:12:31,563 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=143b9c81ebd4a8ee360b27cbda2a70dd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:31,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2b769b1a7161783f077afd8b8da7a871, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:31,563 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498751563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498751563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498751563"}]},"ts":"1689498751563"} 2023-07-16 09:12:31,564 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498751563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498751563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498751563"}]},"ts":"1689498751563"} 2023-07-16 09:12:31,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 143b9c81ebd4a8ee360b27cbda2a70dd, server=jenkins-hbase4.apache.org,34051,1689498639118}] 2023-07-16 09:12:31,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 2b769b1a7161783f077afd8b8da7a871, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:12:31,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:31,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:31,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 143b9c81ebd4a8ee360b27cbda2a70dd, disabling compactions & flushes 2023-07-16 09:12:31,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:31,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:31,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. after waiting 0 ms 2023-07-16 09:12:31,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:31,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:31,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2b769b1a7161783f077afd8b8da7a871, disabling compactions & flushes 2023-07-16 09:12:31,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:31,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:31,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. after waiting 0 ms 2023-07-16 09:12:31,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:31,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:31,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:31,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd. 2023-07-16 09:12:31,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 143b9c81ebd4a8ee360b27cbda2a70dd: 2023-07-16 09:12:31,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:31,793 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=143b9c81ebd4a8ee360b27cbda2a70dd, regionState=CLOSED 2023-07-16 09:12:31,793 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498751793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498751793"}]},"ts":"1689498751793"} 2023-07-16 09:12:31,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-16 09:12:31,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 143b9c81ebd4a8ee360b27cbda2a70dd, server=jenkins-hbase4.apache.org,34051,1689498639118 in 229 msec 2023-07-16 09:12:31,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=143b9c81ebd4a8ee360b27cbda2a70dd, UNASSIGN in 239 msec 2023-07-16 09:12:31,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:31,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:31,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871. 2023-07-16 09:12:31,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2b769b1a7161783f077afd8b8da7a871: 2023-07-16 09:12:31,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:31,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2b769b1a7161783f077afd8b8da7a871, regionState=CLOSED 2023-07-16 09:12:31,815 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498751814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498751814"}]},"ts":"1689498751814"} 2023-07-16 09:12:31,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-16 09:12:31,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 2b769b1a7161783f077afd8b8da7a871, server=jenkins-hbase4.apache.org,36871,1689498639173 in 249 msec 2023-07-16 09:12:31,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:31,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-16 09:12:31,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2b769b1a7161783f077afd8b8da7a871, UNASSIGN in 261 msec 2023-07-16 09:12:31,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498751823"}]},"ts":"1689498751823"} 2023-07-16 09:12:31,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 09:12:31,826 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 09:12:31,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 314 msec 2023-07-16 09:12:32,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:32,122 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 09:12:32,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,127 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,130 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,132 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,138 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:32,138 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:32,142 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/recovered.edits] 2023-07-16 09:12:32,143 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,143 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,143 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,143 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:32,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:32,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:32,145 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,145 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:32,146 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,146 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:32,146 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,146 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:32,146 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/recovered.edits] 2023-07-16 09:12:32,146 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:32,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 09:12:32,148 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf/d2b5f1261c0b4356b7369ea5bc89a51b to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/cf/d2b5f1261c0b4356b7369ea5bc89a51b 2023-07-16 09:12:32,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-16 09:12:32,151 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:12:32,152 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd/recovered.edits/9.seqid 2023-07-16 09:12:32,153 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/143b9c81ebd4a8ee360b27cbda2a70dd 2023-07-16 09:12:32,158 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf/4955fc8e8faa461d9b4622c7fddb42fe to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/cf/4955fc8e8faa461d9b4622c7fddb42fe 2023-07-16 09:12:32,171 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871/recovered.edits/9.seqid 2023-07-16 09:12:32,172 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testEmptyExportFileSystemState/2b769b1a7161783f077afd8b8da7a871 2023-07-16 09:12:32,172 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 09:12:32,175 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,195 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 09:12:32,215 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 09:12:32,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 09:12:32,217 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498752217"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:32,217 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498752217"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:32,234 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:12:32,234 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2b769b1a7161783f077afd8b8da7a871, NAME => 'testtb-testEmptyExportFileSystemState,,1689498739740.2b769b1a7161783f077afd8b8da7a871.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 143b9c81ebd4a8ee360b27cbda2a70dd, NAME => 'testtb-testEmptyExportFileSystemState,1,1689498739740.143b9c81ebd4a8ee360b27cbda2a70dd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:12:32,235 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 09:12:32,235 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498752235"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:32,245 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 09:12:32,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 09:12:32,249 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:32,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 126 msec 2023-07-16 09:12:32,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 09:12:32,451 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 09:12:32,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 09:12:32,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:32,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 09:12:32,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:32,513 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:46739 from appattempt_1689498647051_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4717 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:38961 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:39368 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:34467 from appattempt_1689498647051_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:60848 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:49366 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1810936953_1 at /127.0.0.1:44288 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=739 (was 695) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=1699 (was 2635) 2023-07-16 09:12:32,513 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 09:12:32,545 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=739, ProcessCount=183, AvailableMemoryMB=1695 2023-07-16 09:12:32,545 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 09:12:32,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:12:32,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:32,551 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:12:32,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 09:12:32,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:32,555 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:12:32,559 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:32,559 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:32,559 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 empty. 2023-07-16 09:12:32,560 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f empty. 2023-07-16 09:12:32,560 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:32,560 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:32,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 09:12:32,592 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 09:12:32,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 87caf152febf5f96c4a63c6323be8d68, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:12:32,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 239941660dabfb024ea518694ccaa69f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp 2023-07-16 09:12:32,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:32,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:32,728 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 87caf152febf5f96c4a63c6323be8d68, disabling compactions & flushes 2023-07-16 09:12:32,728 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:32,728 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:32,728 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. after waiting 0 ms 2023-07-16 09:12:32,728 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:32,728 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:32,728 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 87caf152febf5f96c4a63c6323be8d68: 2023-07-16 09:12:32,738 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:32,738 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 239941660dabfb024ea518694ccaa69f, disabling compactions & flushes 2023-07-16 09:12:32,738 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:32,738 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:32,738 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. after waiting 0 ms 2023-07-16 09:12:32,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:32,739 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:32,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 239941660dabfb024ea518694ccaa69f: 2023-07-16 09:12:32,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:12:32,744 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498752744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498752744"}]},"ts":"1689498752744"} 2023-07-16 09:12:32,744 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498752744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498752744"}]},"ts":"1689498752744"} 2023-07-16 09:12:32,748 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:12:32,754 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:12:32,754 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498752754"}]},"ts":"1689498752754"} 2023-07-16 09:12:32,758 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 09:12:32,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:12:32,763 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:12:32,763 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:12:32,764 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:12:32,764 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:12:32,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, ASSIGN}] 2023-07-16 09:12:32,767 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, ASSIGN 2023-07-16 09:12:32,767 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, ASSIGN 2023-07-16 09:12:32,769 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36871,1689498639173; forceNewPlan=false, retain=false 2023-07-16 09:12:32,771 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46593,1689498639060; forceNewPlan=false, retain=false 2023-07-16 09:12:32,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:32,919 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:12:32,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=239941660dabfb024ea518694ccaa69f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:32,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=87caf152febf5f96c4a63c6323be8d68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:32,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498752922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498752922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498752922"}]},"ts":"1689498752922"} 2023-07-16 09:12:32,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498752922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498752922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498752922"}]},"ts":"1689498752922"} 2023-07-16 09:12:32,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 87caf152febf5f96c4a63c6323be8d68, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:12:32,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 239941660dabfb024ea518694ccaa69f, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:33,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:33,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87caf152febf5f96c4a63c6323be8d68, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:12:33,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. service=AccessControlService 2023-07-16 09:12:33,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:33,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:33,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:33,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 239941660dabfb024ea518694ccaa69f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:12:33,087 INFO [StoreOpener-87caf152febf5f96c4a63c6323be8d68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. service=AccessControlService 2023-07-16 09:12:33,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:33,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:33,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,089 DEBUG [StoreOpener-87caf152febf5f96c4a63c6323be8d68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf 2023-07-16 09:12:33,089 DEBUG [StoreOpener-87caf152febf5f96c4a63c6323be8d68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf 2023-07-16 09:12:33,089 INFO [StoreOpener-239941660dabfb024ea518694ccaa69f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,089 INFO [StoreOpener-87caf152febf5f96c4a63c6323be8d68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87caf152febf5f96c4a63c6323be8d68 columnFamilyName cf 2023-07-16 09:12:33,090 INFO [StoreOpener-87caf152febf5f96c4a63c6323be8d68-1] regionserver.HStore(310): Store=87caf152febf5f96c4a63c6323be8d68/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:33,091 DEBUG [StoreOpener-239941660dabfb024ea518694ccaa69f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf 2023-07-16 09:12:33,091 DEBUG [StoreOpener-239941660dabfb024ea518694ccaa69f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf 2023-07-16 09:12:33,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,091 INFO [StoreOpener-239941660dabfb024ea518694ccaa69f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 239941660dabfb024ea518694ccaa69f columnFamilyName cf 2023-07-16 09:12:33,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,092 INFO [StoreOpener-239941660dabfb024ea518694ccaa69f-1] regionserver.HStore(310): Store=239941660dabfb024ea518694ccaa69f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:33,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:33,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:33,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87caf152febf5f96c4a63c6323be8d68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72066842, jitterRate=0.07387962937355042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:33,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87caf152febf5f96c4a63c6323be8d68: 2023-07-16 09:12:33,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:33,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68., pid=108, masterSystemTime=1689498753077 2023-07-16 09:12:33,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:33,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:33,102 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=87caf152febf5f96c4a63c6323be8d68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498753102"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498753102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498753102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498753102"}]},"ts":"1689498753102"} 2023-07-16 09:12:33,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:33,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 239941660dabfb024ea518694ccaa69f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69503832, jitterRate=0.035687804222106934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:33,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 239941660dabfb024ea518694ccaa69f: 2023-07-16 09:12:33,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f., pid=109, masterSystemTime=1689498753079 2023-07-16 09:12:33,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:33,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:33,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-16 09:12:33,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=239941660dabfb024ea518694ccaa69f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 87caf152febf5f96c4a63c6323be8d68, server=jenkins-hbase4.apache.org,36871,1689498639173 in 180 msec 2023-07-16 09:12:33,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498753108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498753108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498753108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498753108"}]},"ts":"1689498753108"} 2023-07-16 09:12:33,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, ASSIGN in 344 msec 2023-07-16 09:12:33,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-16 09:12:33,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 239941660dabfb024ea518694ccaa69f, server=jenkins-hbase4.apache.org,46593,1689498639060 in 184 msec 2023-07-16 09:12:33,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-16 09:12:33,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, ASSIGN in 348 msec 2023-07-16 09:12:33,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:12:33,118 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498753118"}]},"ts":"1689498753118"} 2023-07-16 09:12:33,124 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 09:12:33,127 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:12:33,127 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 09:12:33,130 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 09:12:33,132 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:33,132 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:33,132 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:33,132 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:33,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:33,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:33,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:33,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:33,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 587 msec 2023-07-16 09:12:33,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:33,158 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 09:12:33,158 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-16 09:12:33,158 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:33,169 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-16 09:12:33,170 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:33,170 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-16 09:12:33,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:33,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498753173 (current time:1689498753173). 2023-07-16 09:12:33,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:33,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x0873be76 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:33,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d788e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:33,226 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:33,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0873be76 to 127.0.0.1:59352 2023-07-16 09:12:33,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:33,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x5d07daa7 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:33,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48125f7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:33,272 DEBUG [hconnection-0x77bd4e07-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:33,298 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:33,323 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:33,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d07daa7 to 127.0.0.1:59352 2023-07-16 09:12:33,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:33,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 09:12:33,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:33,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:33,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:33,331 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:33,332 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689499353332 2023-07-16 09:12:33,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:33,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,334 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:33,335 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:33,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:33,338 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:33,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-16 09:12:33,342 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:33,343 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689499353343 2023-07-16 09:12:33,417 WARN [DataStreamer for file /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-16 09:12:33,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,428 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:33,428 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:33,431 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 09:12:33,431 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 09:12:33,436 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:33,436 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,436 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:33,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:33,438 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:33,438 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,438 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:33,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:33,438 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:33,438 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:33,439 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,439 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:33,439 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,439 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 09:12:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,440 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 09:12:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 09:12:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:33,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,452 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:33,453 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:33,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,455 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:33,455 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:33,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:33,464 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:33,470 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:33,470 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:33,470 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:33,471 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,472 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,472 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,473 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:33,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:33,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:33,473 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,474 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,474 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:33,474 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:33,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:33,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:33,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:33,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e66e1fc[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:33,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:33,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:33,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:33,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:33,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:33,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e66e1fc[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:33,480 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 09:12:33,480 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,482 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:33,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,483 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:33,482 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:33,483 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:12:33,483 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,483 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,483 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:33,484 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:33,484 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:33,484 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:33,497 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:33,503 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:33,503 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:33,502 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:33,503 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. started... 2023-07-16 09:12:33,503 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:33,503 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. started... 2023-07-16 09:12:33,503 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:33,510 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 239941660dabfb024ea518694ccaa69f: 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87caf152febf5f96c4a63c6323be8d68: 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:33,511 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:33,598 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. completed. 2023-07-16 09:12:33,598 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:33,598 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:33,598 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:33,598 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,598 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:33,598 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:12:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:33,601 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:33,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:12:33,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 09:12:33,638 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:33,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:33,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:33,639 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:33,940 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:33,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:33,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:33,942 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:12:33,981 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. completed. 2023-07-16 09:12:33,981 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:12:33,984 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:33,985 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:33,986 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:33,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:33,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:33,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:12:33,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 09:12:33,995 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 09:12:33,995 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:33,995 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:33,995 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,995 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:33,999 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,000 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,001 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:34,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,004 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,004 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,005 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,009 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,009 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,010 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,011 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,011 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:34,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,013 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,091 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 09:12:34,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,091 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689498753334Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498754013 (+679 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498754013Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498754027 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498754047 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689498754091 (+44 ms) 2023-07-16 09:12:34,094 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:34,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 758 msec 2023-07-16 09:12:34,442 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:34,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:34,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:34,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46593] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:34,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36871] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:34,462 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,462 DEBUG [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:34,462 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:34,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:34,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498754504 (current time:1689498754504). 2023-07-16 09:12:34,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:34,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x18873ad5 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:34,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55792b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:34,534 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:34,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18873ad5 to 127.0.0.1:59352 2023-07-16 09:12:34,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:34,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x6f2f9d24 to 127.0.0.1:59352 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:34,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4edf5386, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:34,643 DEBUG [hconnection-0x7724badb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:34,644 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:34,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:34,652 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:34,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f2f9d24 to 127.0.0.1:59352 2023-07-16 09:12:34,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:34,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 09:12:34,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:34,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:34,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:34,657 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:34,658 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689499354658 2023-07-16 09:12:34,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:34,659 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:34,659 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:34,660 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:34,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:34,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-16 09:12:34,662 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:34,662 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689499354662 2023-07-16 09:12:34,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,671 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:34,671 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:34,672 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 09:12:34,672 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 09:12:34,673 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,673 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,675 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,675 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,675 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,675 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,675 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,675 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,676 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,676 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 09:12:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 09:12:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:34,678 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:34,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:34,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,678 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:34,678 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:34,678 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:34,678 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34051,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:34,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:34,682 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,682 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,682 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:34,683 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,683 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,683 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:34,683 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,683 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:34,683 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,684 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,684 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46593,1689498639060' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@453a46fa[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:34,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36871,1689498639173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:34,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@453a46fa[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:34,688 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 09:12:34,688 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,693 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,693 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,693 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,694 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34051,1689498639118' in zk 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:34,694 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:34,694 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:34,694 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:34,694 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:34,694 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. started... 2023-07-16 09:12:34,694 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:34,694 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. started... 2023-07-16 09:12:34,695 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87caf152febf5f96c4a63c6323be8d68 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 09:12:34,695 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 239941660dabfb024ea518694ccaa69f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 09:12:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:34,696 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:34,696 DEBUG [member: 'jenkins-hbase4.apache.org,34051,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:34,707 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/.tmp/cf/3786fca83de84925ade7e9df0a08d779 2023-07-16 09:12:34,707 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/.tmp/cf/5e3637a9b9e845168c9bf6ade6a0d0b5 2023-07-16 09:12:34,712 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/.tmp/cf/3786fca83de84925ade7e9df0a08d779 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf/3786fca83de84925ade7e9df0a08d779 2023-07-16 09:12:34,712 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/.tmp/cf/5e3637a9b9e845168c9bf6ade6a0d0b5 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf/5e3637a9b9e845168c9bf6ade6a0d0b5 2023-07-16 09:12:34,716 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf/3786fca83de84925ade7e9df0a08d779, entries=2, sequenceid=6, filesize=5.0 K 2023-07-16 09:12:34,716 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf/5e3637a9b9e845168c9bf6ade6a0d0b5, entries=48, sequenceid=6, filesize=8.1 K 2023-07-16 09:12:34,717 INFO [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 87caf152febf5f96c4a63c6323be8d68 in 22ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:34,717 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:34,717 INFO [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 239941660dabfb024ea518694ccaa69f in 23ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:34,717 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87caf152febf5f96c4a63c6323be8d68: 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 239941660dabfb024ea518694ccaa69f: 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf/3786fca83de84925ade7e9df0a08d779] hfiles 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf/5e3637a9b9e845168c9bf6ade6a0d0b5] hfiles 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf/5e3637a9b9e845168c9bf6ade6a0d0b5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,720 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf/3786fca83de84925ade7e9df0a08d779 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,737 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. completed. 2023-07-16 09:12:34,738 DEBUG [rs(jenkins-hbase4.apache.org,36871,1689498639173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36871,1689498639173' in zk 2023-07-16 09:12:34,738 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. completed. 2023-07-16 09:12:34,738 DEBUG [rs(jenkins-hbase4.apache.org,46593,1689498639060)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:34,738 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46593,1689498639060' in zk 2023-07-16 09:12:34,740 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,36871,1689498639173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:34,741 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,46593,1689498639060' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36871,1689498639173': 2023-07-16 09:12:34,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36871,1689498639173' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 09:12:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46593,1689498639060': 2023-07-16 09:12:34,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46593,1689498639060' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 09:12:34,750 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 09:12:34,750 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:34,750 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:34,750 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,750 INFO [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:34,753 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:34,753 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:34,753 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,754 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:34,754 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,755 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,757 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,758 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,759 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,759 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:34,759 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:34,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:34,761 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,763 DEBUG [(jenkins-hbase4.apache.org,39521,1689498637562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,763 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:34,765 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:34,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,961 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:34,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:34,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:34,963 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:34,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 09:12:34,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,969 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:34,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689498754658Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689498754765 (+107 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689498754765Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689498754783 (+18 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689498754889 (+106 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689498754968 (+79 ms) 2023-07-16 09:12:34,972 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:34,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 313 msec 2023-07-16 09:12:35,263 DEBUG [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:35,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:35,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:35,265 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265 2023-07-16 09:12:35,265 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33301, tgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265, rawTgtDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265, srcFsUri=hdfs://localhost:33301, srcDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:12:35,289 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb 2023-07-16 09:12:35,289 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1841768968_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:35,289 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33301, inputRoot=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb, snapshotDir=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 09:12:35,303 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:35,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,322 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,324 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,394 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/hadoop-5703603887377199441.jar 2023-07-16 09:12:35,395 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,395 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,395 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:35,397 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:12:35,397 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:12:35,398 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:12:35,398 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:12:35,399 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:12:35,399 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:12:35,400 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:12:35,400 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:12:35,401 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:12:35,401 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:12:35,402 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:35,402 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:35,404 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:35,404 DEBUG [Listener at jenkins-hbase4.apache.org/46737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:36,120 WARN [Listener at jenkins-hbase4.apache.org/46737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:12:36,124 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 09:12:36,127 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 09:12:36,632 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:36,633 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:36,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0006_000001 (auth:SIMPLE) 2023-07-16 09:12:37,398 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:37,398 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:42,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:45,177 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:48,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:49,648 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:12:49,648 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:12:49,662 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,662 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:12:49,663 INFO [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:12:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,663 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 09:12:49,664 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 09:12:49,664 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_288027233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,664 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 09:12:49,664 DEBUG [Listener at jenkins-hbase4.apache.org/46737] snapshot.TestExportSnapshot(367): hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/export-test/export-1689498755265/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 09:12:49,671 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,676 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498769676"}]},"ts":"1689498769676"} 2023-07-16 09:12:49,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 09:12:49,677 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 09:12:49,679 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 09:12:49,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, UNASSIGN}] 2023-07-16 09:12:49,682 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, UNASSIGN 2023-07-16 09:12:49,682 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, UNASSIGN 2023-07-16 09:12:49,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=87caf152febf5f96c4a63c6323be8d68, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:12:49,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498769686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498769686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498769686"}]},"ts":"1689498769686"} 2023-07-16 09:12:49,687 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=239941660dabfb024ea518694ccaa69f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:12:49,687 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498769687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498769687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498769687"}]},"ts":"1689498769687"} 2023-07-16 09:12:49,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 87caf152febf5f96c4a63c6323be8d68, server=jenkins-hbase4.apache.org,36871,1689498639173}] 2023-07-16 09:12:49,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 239941660dabfb024ea518694ccaa69f, server=jenkins-hbase4.apache.org,46593,1689498639060}] 2023-07-16 09:12:49,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 09:12:49,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 239941660dabfb024ea518694ccaa69f, disabling compactions & flushes 2023-07-16 09:12:49,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:49,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87caf152febf5f96c4a63c6323be8d68, disabling compactions & flushes 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. after waiting 0 ms 2023-07-16 09:12:49,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. after waiting 0 ms 2023-07-16 09:12:49,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:49,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:49,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:49,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:49,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:49,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68. 2023-07-16 09:12:49,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87caf152febf5f96c4a63c6323be8d68: 2023-07-16 09:12:49,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f. 2023-07-16 09:12:49,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 239941660dabfb024ea518694ccaa69f: 2023-07-16 09:12:49,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:49,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=87caf152febf5f96c4a63c6323be8d68, regionState=CLOSED 2023-07-16 09:12:49,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498769863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498769863"}]},"ts":"1689498769863"} 2023-07-16 09:12:49,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:49,863 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=239941660dabfb024ea518694ccaa69f, regionState=CLOSED 2023-07-16 09:12:49,864 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498769863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498769863"}]},"ts":"1689498769863"} 2023-07-16 09:12:49,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-16 09:12:49,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 87caf152febf5f96c4a63c6323be8d68, server=jenkins-hbase4.apache.org,36871,1689498639173 in 175 msec 2023-07-16 09:12:49,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87caf152febf5f96c4a63c6323be8d68, UNASSIGN in 189 msec 2023-07-16 09:12:49,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-16 09:12:49,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 239941660dabfb024ea518694ccaa69f, server=jenkins-hbase4.apache.org,46593,1689498639060 in 177 msec 2023-07-16 09:12:49,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 09:12:49,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=239941660dabfb024ea518694ccaa69f, UNASSIGN in 192 msec 2023-07-16 09:12:49,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498769876"}]},"ts":"1689498769876"} 2023-07-16 09:12:49,878 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 09:12:49,881 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 09:12:49,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 211 msec 2023-07-16 09:12:49,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 09:12:49,979 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 09:12:49,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,984 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,986 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,987 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,993 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:49,994 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,994 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,994 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 09:12:49,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 09:12:49,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 09:12:49,995 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,995 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:49,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:49,996 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:49,996 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:49,997 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/recovered.edits] 2023-07-16 09:12:49,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 09:12:50,001 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf/3786fca83de84925ade7e9df0a08d779 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/cf/3786fca83de84925ade7e9df0a08d779 2023-07-16 09:12:50,003 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf, FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/recovered.edits] 2023-07-16 09:12:50,006 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68/recovered.edits/9.seqid 2023-07-16 09:12:50,007 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87caf152febf5f96c4a63c6323be8d68 2023-07-16 09:12:50,009 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf/5e3637a9b9e845168c9bf6ade6a0d0b5 to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/cf/5e3637a9b9e845168c9bf6ade6a0d0b5 2023-07-16 09:12:50,012 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/recovered.edits/9.seqid to hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f/recovered.edits/9.seqid 2023-07-16 09:12:50,014 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/239941660dabfb024ea518694ccaa69f 2023-07-16 09:12:50,014 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 09:12:50,017 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:50,024 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 09:12:50,029 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 09:12:50,030 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:50,031 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 09:12:50,031 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498770031"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:50,031 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498770031"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:50,036 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:12:50,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87caf152febf5f96c4a63c6323be8d68, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689498752547.87caf152febf5f96c4a63c6323be8d68.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 239941660dabfb024ea518694ccaa69f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498752547.239941660dabfb024ea518694ccaa69f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:12:50,037 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 09:12:50,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498770037"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:50,039 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 09:12:50,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:50,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 61 msec 2023-07-16 09:12:50,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 09:12:50,099 INFO [Listener at jenkins-hbase4.apache.org/46737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 09:12:50,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 09:12:50,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:50,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 09:12:50,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:50,166 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 764) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:41393 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-963353337_1 at /127.0.0.1:52278 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57ac7d77-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5323 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-963353337_1 at /127.0.0.1:36848 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:36242 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:36874 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_288027233_17 at /127.0.0.1:52296 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=819 (was 739) - SystemLoadAverage LEAK? -, ProcessCount=191 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=1810 (was 1695) - AvailableMemoryMB LEAK? - 2023-07-16 09:12:50,167 WARN [Listener at jenkins-hbase4.apache.org/46737] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-16 09:12:50,167 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 09:12:50,217 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:12:54,606 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647051_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:55,434 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:13:04,338 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:13:18,462 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 09:13:18,463 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:13:18,580 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 09:13:18,590 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 09:13:18,591 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 09:13:18,600 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:13:18,703 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 09:13:18,704 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 09:13:18,704 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 09:13:18,704 INFO [Listener at jenkins-hbase4.apache.org/46737] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 09:13:18,704 DEBUG [Listener at jenkins-hbase4.apache.org/46737] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40bb1f00 to 127.0.0.1:59352 2023-07-16 09:13:18,704 DEBUG [Listener at jenkins-hbase4.apache.org/46737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,704 DEBUG [Listener at jenkins-hbase4.apache.org/46737] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 09:13:18,705 DEBUG [Listener at jenkins-hbase4.apache.org/46737] util.JVMClusterUtil(257): Found active master hash=1467140829, stopped=false 2023-07-16 09:13:18,705 DEBUG [Listener at jenkins-hbase4.apache.org/46737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:18,705 DEBUG [Listener at jenkins-hbase4.apache.org/46737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 09:13:18,705 INFO [Listener at jenkins-hbase4.apache.org/46737] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:13:18,707 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:18,707 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:13:18,707 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:18,707 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:18,707 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:18,707 INFO [Listener at jenkins-hbase4.apache.org/46737] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 09:13:18,708 DEBUG [Listener at jenkins-hbase4.apache.org/46737] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5037eedb to 127.0.0.1:59352 2023-07-16 09:13:18,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:18,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:18,708 DEBUG [Listener at jenkins-hbase4.apache.org/46737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:18,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:18,710 INFO [Listener at jenkins-hbase4.apache.org/46737] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46593,1689498639060' ***** 2023-07-16 09:13:18,710 DEBUG [Listener at jenkins-hbase4.apache.org/46737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:18,710 INFO [Listener at jenkins-hbase4.apache.org/46737] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 09:13:18,710 INFO [Listener at jenkins-hbase4.apache.org/46737] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34051,1689498639118' ***** 2023-07-16 09:13:18,710 DEBUG [Listener at jenkins-hbase4.apache.org/46737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:18,710 INFO [Listener at jenkins-hbase4.apache.org/46737] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 09:13:18,710 INFO [Listener at jenkins-hbase4.apache.org/46737] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36871,1689498639173' ***** 2023-07-16 09:13:18,711 INFO [RS:1;jenkins-hbase4:34051] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 09:13:18,711 DEBUG [Listener at jenkins-hbase4.apache.org/46737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:18,710 INFO [RS:0;jenkins-hbase4:46593] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 09:13:18,711 INFO [RS:1;jenkins-hbase4:34051] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 09:13:18,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 09:13:18,711 INFO [RS:1;jenkins-hbase4:34051] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 09:13:18,711 INFO [Listener at jenkins-hbase4.apache.org/46737] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 09:13:18,711 INFO [RS:0;jenkins-hbase4:46593] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 09:13:18,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 09:13:18,711 INFO [RS:2;jenkins-hbase4:36871] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 09:13:18,711 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(3305): Received CLOSE for f645c4baf35786e6438275311f40f057 2023-07-16 09:13:18,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 09:13:18,711 INFO [RS:0;jenkins-hbase4:46593] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 09:13:18,711 INFO [RS:2;jenkins-hbase4:36871] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 09:13:18,712 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:13:18,712 INFO [RS:2;jenkins-hbase4:36871] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 09:13:18,712 DEBUG [RS:0;jenkins-hbase4:46593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x475c5908 to 127.0.0.1:59352 2023-07-16 09:13:18,712 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:13:18,712 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(3305): Received CLOSE for 6833dbe3eacfd58d8702f764ccd702d2 2023-07-16 09:13:18,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f645c4baf35786e6438275311f40f057, disabling compactions & flushes 2023-07-16 09:13:18,712 DEBUG [RS:2;jenkins-hbase4:36871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44a72ef5 to 127.0.0.1:59352 2023-07-16 09:13:18,712 DEBUG [RS:0;jenkins-hbase4:46593] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,713 DEBUG [RS:2;jenkins-hbase4:36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,715 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46593,1689498639060; all regions closed. 2023-07-16 09:13:18,715 INFO [RS:2;jenkins-hbase4:36871] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 09:13:18,715 INFO [RS:2;jenkins-hbase4:36871] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 09:13:18,715 INFO [RS:2;jenkins-hbase4:36871] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 09:13:18,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:13:18,713 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:13:18,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:13:18,716 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 09:13:18,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. after waiting 0 ms 2023-07-16 09:13:18,716 DEBUG [RS:1;jenkins-hbase4:34051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3569ee52 to 127.0.0.1:59352 2023-07-16 09:13:18,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:13:18,716 DEBUG [RS:1;jenkins-hbase4:34051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,716 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 09:13:18,716 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-16 09:13:18,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f645c4baf35786e6438275311f40f057 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 09:13:18,717 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-16 09:13:18,717 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1478): Online Regions={f645c4baf35786e6438275311f40f057=hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057., 6833dbe3eacfd58d8702f764ccd702d2=hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2.} 2023-07-16 09:13:18,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 09:13:18,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 09:13:18,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 09:13:18,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 09:13:18,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 09:13:18,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 09:13:18,718 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 09:13:18,718 DEBUG [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1504): Waiting on 6833dbe3eacfd58d8702f764ccd702d2, f645c4baf35786e6438275311f40f057 2023-07-16 09:13:18,737 DEBUG [RS:0;jenkins-hbase4:46593] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs 2023-07-16 09:13:18,738 INFO [RS:0;jenkins-hbase4:46593] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46593%2C1689498639060:(num 1689498641451) 2023-07-16 09:13:18,738 DEBUG [RS:0;jenkins-hbase4:46593] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,738 INFO [RS:0;jenkins-hbase4:46593] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:18,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/.tmp/l/54cdca80e99b4b62bef65759bbbbaac7 2023-07-16 09:13:18,743 INFO [RS:0;jenkins-hbase4:46593] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 09:13:18,746 INFO [RS:0;jenkins-hbase4:46593] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 09:13:18,746 INFO [RS:0;jenkins-hbase4:46593] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 09:13:18,746 INFO [RS:0;jenkins-hbase4:46593] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 09:13:18,746 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:18,754 INFO [RS:0;jenkins-hbase4:46593] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46593 2023-07-16 09:13:18,759 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:18,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54cdca80e99b4b62bef65759bbbbaac7 2023-07-16 09:13:18,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/.tmp/l/54cdca80e99b4b62bef65759bbbbaac7 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/l/54cdca80e99b4b62bef65759bbbbaac7 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46593,1689498639060 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:18,761 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:18,761 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46593,1689498639060] 2023-07-16 09:13:18,762 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46593,1689498639060; numProcessing=1 2023-07-16 09:13:18,764 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46593,1689498639060 already deleted, retry=false 2023-07-16 09:13:18,764 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46593,1689498639060 expired; onlineServers=2 2023-07-16 09:13:18,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54cdca80e99b4b62bef65759bbbbaac7 2023-07-16 09:13:18,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/l/54cdca80e99b4b62bef65759bbbbaac7, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 09:13:18,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f645c4baf35786e6438275311f40f057 in 52ms, sequenceid=18, compaction requested=false 2023-07-16 09:13:18,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/acl/f645c4baf35786e6438275311f40f057/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 09:13:18,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:18,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:13:18,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f645c4baf35786e6438275311f40f057: 2023-07-16 09:13:18,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689498642873.f645c4baf35786e6438275311f40f057. 2023-07-16 09:13:18,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6833dbe3eacfd58d8702f764ccd702d2, disabling compactions & flushes 2023-07-16 09:13:18,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:13:18,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:13:18,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. after waiting 0 ms 2023-07-16 09:13:18,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:13:18,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6833dbe3eacfd58d8702f764ccd702d2 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 09:13:18,787 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:18,788 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:18,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/.tmp/info/c6044e506657404ab7b759a09f2235e8 2023-07-16 09:13:18,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/.tmp/info/c6044e506657404ab7b759a09f2235e8 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/info/c6044e506657404ab7b759a09f2235e8 2023-07-16 09:13:18,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/info/c6044e506657404ab7b759a09f2235e8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 09:13:18,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6833dbe3eacfd58d8702f764ccd702d2 in 18ms, sequenceid=6, compaction requested=false 2023-07-16 09:13:18,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/namespace/6833dbe3eacfd58d8702f764ccd702d2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:13:18,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:18,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:13:18,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6833dbe3eacfd58d8702f764ccd702d2: 2023-07-16 09:13:18,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689498641996.6833dbe3eacfd58d8702f764ccd702d2. 2023-07-16 09:13:18,864 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:18,864 INFO [RS:0;jenkins-hbase4:46593] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46593,1689498639060; zookeeper connection closed. 2023-07-16 09:13:18,864 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:46593-0x1016d65d4180001, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:18,864 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@75faa698] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@75faa698 2023-07-16 09:13:18,918 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34051,1689498639118; all regions closed. 2023-07-16 09:13:18,918 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 09:13:18,924 DEBUG [RS:1;jenkins-hbase4:34051] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs 2023-07-16 09:13:18,924 INFO [RS:1;jenkins-hbase4:34051] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34051%2C1689498639118:(num 1689498641400) 2023-07-16 09:13:18,924 DEBUG [RS:1;jenkins-hbase4:34051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:18,924 INFO [RS:1;jenkins-hbase4:34051] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:18,925 INFO [RS:1;jenkins-hbase4:34051] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 09:13:18,925 INFO [RS:1;jenkins-hbase4:34051] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 09:13:18,925 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:18,925 INFO [RS:1;jenkins-hbase4:34051] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 09:13:18,925 INFO [RS:1;jenkins-hbase4:34051] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 09:13:18,926 INFO [RS:1;jenkins-hbase4:34051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34051 2023-07-16 09:13:18,928 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:13:18,928 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34051,1689498639118 2023-07-16 09:13:18,928 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:18,929 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34051,1689498639118] 2023-07-16 09:13:18,929 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34051,1689498639118; numProcessing=2 2023-07-16 09:13:18,931 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34051,1689498639118 already deleted, retry=false 2023-07-16 09:13:18,931 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34051,1689498639118 expired; onlineServers=1 2023-07-16 09:13:19,029 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:19,029 INFO [RS:1;jenkins-hbase4:34051] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34051,1689498639118; zookeeper connection closed. 2023-07-16 09:13:19,029 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:34051-0x1016d65d4180002, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:19,029 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@23ecccff] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@23ecccff 2023-07-16 09:13:19,119 DEBUG [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 09:13:19,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/.tmp/info/709d9d00e1194d48ab54b3e94245f238 2023-07-16 09:13:19,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 709d9d00e1194d48ab54b3e94245f238 2023-07-16 09:13:19,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/.tmp/rep_barrier/fda0b7ca9e5045b69ed0d49cc628b497 2023-07-16 09:13:19,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fda0b7ca9e5045b69ed0d49cc628b497 2023-07-16 09:13:19,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/.tmp/table/00226cf324f64715ade19db571757f47 2023-07-16 09:13:19,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00226cf324f64715ade19db571757f47 2023-07-16 09:13:19,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/.tmp/info/709d9d00e1194d48ab54b3e94245f238 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/info/709d9d00e1194d48ab54b3e94245f238 2023-07-16 09:13:19,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 709d9d00e1194d48ab54b3e94245f238 2023-07-16 09:13:19,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/info/709d9d00e1194d48ab54b3e94245f238, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 09:13:19,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/.tmp/rep_barrier/fda0b7ca9e5045b69ed0d49cc628b497 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/rep_barrier/fda0b7ca9e5045b69ed0d49cc628b497 2023-07-16 09:13:19,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fda0b7ca9e5045b69ed0d49cc628b497 2023-07-16 09:13:19,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/rep_barrier/fda0b7ca9e5045b69ed0d49cc628b497, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 09:13:19,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/.tmp/table/00226cf324f64715ade19db571757f47 as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/table/00226cf324f64715ade19db571757f47 2023-07-16 09:13:19,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00226cf324f64715ade19db571757f47 2023-07-16 09:13:19,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/table/00226cf324f64715ade19db571757f47, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 09:13:19,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 504ms, sequenceid=131, compaction requested=false 2023-07-16 09:13:19,223 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 09:13:19,223 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 09:13:19,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 09:13:19,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:19,237 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 09:13:19,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 09:13:19,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 09:13:19,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 09:13:19,319 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36871,1689498639173; all regions closed. 2023-07-16 09:13:19,331 DEBUG [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs 2023-07-16 09:13:19,331 INFO [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36871%2C1689498639173.meta:.meta(num 1689498641597) 2023-07-16 09:13:19,337 DEBUG [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/oldWALs 2023-07-16 09:13:19,337 INFO [RS:2;jenkins-hbase4:36871] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36871%2C1689498639173:(num 1689498641451) 2023-07-16 09:13:19,337 DEBUG [RS:2;jenkins-hbase4:36871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:19,337 INFO [RS:2;jenkins-hbase4:36871] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:19,337 INFO [RS:2;jenkins-hbase4:36871] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 09:13:19,337 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:19,338 INFO [RS:2;jenkins-hbase4:36871] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36871 2023-07-16 09:13:19,340 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:19,340 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36871,1689498639173 2023-07-16 09:13:19,340 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36871,1689498639173] 2023-07-16 09:13:19,340 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36871,1689498639173; numProcessing=3 2023-07-16 09:13:19,342 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36871,1689498639173 already deleted, retry=false 2023-07-16 09:13:19,342 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36871,1689498639173 expired; onlineServers=0 2023-07-16 09:13:19,342 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39521,1689498637562' ***** 2023-07-16 09:13:19,342 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 09:13:19,342 DEBUG [M:0;jenkins-hbase4:39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@164fc0e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:13:19,342 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39521,1689498637562 2023-07-16 09:13:19,342 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39521,1689498637562; all regions closed. 2023-07-16 09:13:19,342 DEBUG [M:0;jenkins-hbase4:39521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:19,342 DEBUG [M:0;jenkins-hbase4:39521] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 09:13:19,343 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 09:13:19,343 DEBUG [M:0;jenkins-hbase4:39521] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 09:13:19,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689498640940] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689498640940,5,FailOnTimeoutGroup] 2023-07-16 09:13:19,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689498640931] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689498640931,5,FailOnTimeoutGroup] 2023-07-16 09:13:19,343 INFO [M:0;jenkins-hbase4:39521] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 09:13:19,343 INFO [M:0;jenkins-hbase4:39521] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 09:13:19,343 INFO [M:0;jenkins-hbase4:39521] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 09:13:19,343 DEBUG [M:0;jenkins-hbase4:39521] master.HMaster(1512): Stopping service threads 2023-07-16 09:13:19,343 INFO [M:0;jenkins-hbase4:39521] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 09:13:19,343 ERROR [M:0;jenkins-hbase4:39521] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 09:13:19,344 INFO [M:0;jenkins-hbase4:39521] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 09:13:19,344 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 09:13:19,345 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 09:13:19,345 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:13:19,345 DEBUG [M:0;jenkins-hbase4:39521] zookeeper.ZKUtil(398): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 09:13:19,345 WARN [M:0;jenkins-hbase4:39521] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 09:13:19,345 INFO [M:0;jenkins-hbase4:39521] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 09:13:19,345 INFO [M:0;jenkins-hbase4:39521] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 09:13:19,346 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 09:13:19,346 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:19,346 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:19,346 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 09:13:19,346 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:19,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:13:19,346 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.35 KB heapSize=449.64 KB 2023-07-16 09:13:19,376 INFO [M:0;jenkins-hbase4:39521] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.35 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/15073872a9f84cb4a334ef3acd47277e 2023-07-16 09:13:19,382 INFO [M:0;jenkins-hbase4:39521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15073872a9f84cb4a334ef3acd47277e 2023-07-16 09:13:19,383 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/15073872a9f84cb4a334ef3acd47277e as hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/15073872a9f84cb4a334ef3acd47277e 2023-07-16 09:13:19,387 INFO [M:0;jenkins-hbase4:39521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15073872a9f84cb4a334ef3acd47277e 2023-07-16 09:13:19,387 INFO [M:0;jenkins-hbase4:39521] regionserver.HStore(1080): Added hdfs://localhost:33301/user/jenkins/test-data/330a3b6c-b1ed-0a48-b196-ae4179fb5fdb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/15073872a9f84cb4a334ef3acd47277e, entries=119, sequenceid=899, filesize=28.5 K 2023-07-16 09:13:19,388 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(2948): Finished flush of dataSize ~373.35 KB/382311, heapSize ~449.63 KB/460416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=899, compaction requested=false 2023-07-16 09:13:19,390 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:19,390 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 09:13:19,395 INFO [M:0;jenkins-hbase4:39521] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 09:13:19,395 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:19,396 INFO [M:0;jenkins-hbase4:39521] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39521 2023-07-16 09:13:19,397 DEBUG [M:0;jenkins-hbase4:39521] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39521,1689498637562 already deleted, retry=false 2023-07-16 09:13:19,441 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:19,441 INFO [RS:2;jenkins-hbase4:36871] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36871,1689498639173; zookeeper connection closed. 2023-07-16 09:13:19,442 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): regionserver:36871-0x1016d65d4180003, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:19,442 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1477f658] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1477f658 2023-07-16 09:13:19,442 INFO [Listener at jenkins-hbase4.apache.org/46737] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 09:13:19,542 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:19,542 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39521,1689498637562; zookeeper connection closed. 2023-07-16 09:13:19,542 DEBUG [Listener at localhost/43761-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1016d65d4180000, quorum=127.0.0.1:59352, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:19,543 WARN [Listener at jenkins-hbase4.apache.org/46737] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 09:13:19,547 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:19,676 WARN [BP-2063753660-172.31.14.131-1689498633600 heartbeating to localhost/127.0.0.1:33301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 09:13:19,676 WARN [BP-2063753660-172.31.14.131-1689498633600 heartbeating to localhost/127.0.0.1:33301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2063753660-172.31.14.131-1689498633600 (Datanode Uuid eac4b949-0890-47eb-b5fe-33528ae8c9b5) service to localhost/127.0.0.1:33301 2023-07-16 09:13:19,678 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data5/current/BP-2063753660-172.31.14.131-1689498633600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:19,678 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data6/current/BP-2063753660-172.31.14.131-1689498633600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:19,681 WARN [Listener at jenkins-hbase4.apache.org/46737] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 09:13:19,690 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:19,695 WARN [BP-2063753660-172.31.14.131-1689498633600 heartbeating to localhost/127.0.0.1:33301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 09:13:19,695 WARN [BP-2063753660-172.31.14.131-1689498633600 heartbeating to localhost/127.0.0.1:33301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2063753660-172.31.14.131-1689498633600 (Datanode Uuid 215dacd7-4f69-481c-b7e0-cc9a9db81a1c) service to localhost/127.0.0.1:33301 2023-07-16 09:13:19,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data3/current/BP-2063753660-172.31.14.131-1689498633600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:19,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data4/current/BP-2063753660-172.31.14.131-1689498633600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:19,697 WARN [Listener at jenkins-hbase4.apache.org/46737] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 09:13:19,705 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:19,808 WARN [BP-2063753660-172.31.14.131-1689498633600 heartbeating to localhost/127.0.0.1:33301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 09:13:19,808 WARN [BP-2063753660-172.31.14.131-1689498633600 heartbeating to localhost/127.0.0.1:33301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2063753660-172.31.14.131-1689498633600 (Datanode Uuid bd559ca0-edb1-45e5-9b3c-89cadbc002c7) service to localhost/127.0.0.1:33301 2023-07-16 09:13:19,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data1/current/BP-2063753660-172.31.14.131-1689498633600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:19,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5d15b61-7224-b2c8-a496-176c8f49f4cb/cluster_cac90d47-c8f2-e6e2-fe64-cae0a19f9b15/dfs/data/data2/current/BP-2063753660-172.31.14.131-1689498633600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:19,832 INFO [Listener at jenkins-hbase4.apache.org/46737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:19,958 INFO [Listener at jenkins-hbase4.apache.org/46737] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 09:13:20,085 INFO [Listener at jenkins-hbase4.apache.org/46737] hbase.HBaseTestingUtility(1293): Minicluster is down